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Description 
Concurrent Processing Memory 

Cross Reference to Related Applications 

[0001] The present application claims the benefit of Provisional 

Application Number 60/320250 filed June 6, 2003 by 

Chengpu Wang. 
Copyright Statement 

[0002] A portion of the disclosure of this patent document con- 
tains material which is subject to copyright protection. 
The copyright owner has no objection to the facsimile re- 
production by anyone of the patent document or the 
patent disclosure, as it appears in the Patent and Trade- 
mark Office patent files or records, but otherwise reserves 

all copyright rights whatsoever. 
Background of Invention 

[0003] In the past 40 years, the semiconductor industry has been 
dictated by Moore's law, which says for every one and half 
years, the density of semiconductor devices doubles. 
Moore's law has also applied to CPU speed in a similar 



fashion. However, in recent years, tlie semiconductor in- 
dustry lias slowed down and deviated noticeably from the 
Moore's law, e.g. the increase of the clock speed of CPU 
can no longer keep the same pace. Also, the industry 
faces two major technology challenges for further size re- 
duction: (A) the transition from classical circuit to quan- 
tum circuit, and (B) the transition from far-field (wave) 
manufacture technology to near-field (nano) manufacture 
technology. At this moment an important question is: Are 
our computers fast enough? 
[0004] The majority of our computers, including PC, Unix, Macin- 
tosh, and most embedded computers, are bus-sharing 
computers, in which there is: (A) a memory unit that 
stores instructions and data, (B) a processing unit that ex- 
ecutes the instructions one after another, to process the 
data, and (C) a bus unit that connects the two. At MHz or 
even GHz of clock rate, and even with multiple CPUs 
within the processing unit, our bus-sharing computers 
seem quite fast for solving most serial problems which 
contains sequence of instructions, yet they are ill 
equipped when dealing with parallel problems such as 
searching and ordering database, processing image, and 
modeling involving space, mainly due to the following 



reasons: 

[0005] (1) The parallel nature of the problem is different from the 
serial way in which the problem is solved in bus-sharing 
computers. In a parallel problem, a procedure is applied 
independently to each item of an array. The collection of 
such applications can be carried out concurrently. Yet a 
bus-sharing computer can only carry out them one after 
another. The drawback is two fold: (A) The amount of data 
could be huge, e.g., even a common digital camera con- 
tains million of pixels. If a same procedure has to be re- 
peated for each array item, it is a very slow solution. For 
an example, to process a photo taken by a common digi- 
tal camera, a bus-sharing computer has to repeat a same 
procedure of a parallel problem at least millions times. (B) 
Each application of the procedure contains many same 
operations on the same data, and a bus-sharing computer 
has to repeat every one of them for each different datum. 
Thus, it is also a very inefficient solution. For an example, 
every pair of neighboring data has to be summed multiple 
times in any neighborhood averaging scheme. 

[0006] (2) The large amount of required data transfer for carrying 
out the serial solution for a parallel problem will boggle 
down the bus unit in a bus-sharing computer. Actually, 



the bus unit is already normally much slower than the 
processing unit, e.g., in PC, it has been always about 5 
times slower for the past ten years. The speed of a bus- 
sharing computer is usually determined by the speed at 
which the bus unit can supply instructions and data from 
the memory unit to the processing unit. This is called a 
bus bottleneck problem. Trying to cope with this bus bot- 
tleneck is already the major task of a modern CPU, e.g. 
costing about 70% of die area of a Pentium III CPU. Flush- 
ing the bus unit of a bus-sharing computer with a lot of 
repeated instructions and repeated data when solving a 
parallel problem serially can only make the matter much 
worse. For an example, the simplest neighborhood aver- 
aging of a digital camera photo in a bus-sharing com- 
puter requires tens of millions times of pixel data trans- 
fer, and all of them are repeated. This adds a lot of stress 
to the bus unit of the bus-sharing computer. 
[0007] The above drawbacks of the bus-sharing computer origi- 
nate from the separation of (A) the processing and (B) the 
storing of instructions and data. With the currently 
achievable semiconductor size and new developments in 
silicon integration, it is quite desirable to merge the pro- 
cessing and the storing of instructions and data into one 



unit. The end of the Moore's law actually provides devel- 
opment possibilities in other dimensions. 

[0008] Still, it is not the time to dismiss our bus-sharing com- 
puters yet. In addition to their well known advantages of 
maturity and ubiquity, and amazing abilities for serial 
problems, bus-sharing computers have one hidden ad- 
vantage: they fit our Human logic well. Our Human logic is 
based on induction and deduction, both of which are se- 
rial in nature. We only deal with parallel problems as one 
of the steps of our serial problems. The bus-sharing com- 
puters have the architecture that guarantees the serial ex- 
ecution of instructions, and provides bases for proper 
synchronization between multiple threads of serial execu- 
tions. Even the reconfigurable systems, such as PLD and 
FPGA, which are frequently associated with parallel data 
processing, are mostly configured in programs, which 
comprise serial descriptive instructions and are processed 
by bus-sharing computers using serial instructions. 

[0009] Another hidden advantage of our bus-sharing computers 
is that they can have a powerful processing unit that can 
do almost everything. On the other hand, any solution for 
parallel problems based on massive parallel processing 
can not be universal to make economical sense. It is justi- 



fied to have one or a few very complicated CPUs for one 
computer. It is probably not justified to have one very 
complicated CPU for every datum in a large pool of data. 
[0010] So a fast and efficient solution to our parallel problems 

may call for a device that: (A) integrates seamlessly with a 
bus-sharing architecture; (B) is controlled by the process- 
ing unit of the bus-sharing architecture and is part of the 
memory unit; (C) is limited to the application of parallel 
problems only; (D) stores the data for the parallel prob- 
lem; (E) processes the data locally near each datum; (F) 
solves the parallel problem using massive parallel algo- 
rithm, such as SIMD (Single-Instruction Multiple-Data) in 
particular; and (G) has minimal impact on the bus unit of 
the bus-sharing architecture. Or in another word, what we 
need is a smart memory for each particular kind of paral- 
lel problems. 

[0011] information relevant to attempts to build memory with 
some internal processing power can be found in U.S. 
Patent No 6,460,127, 6,404,439, 6,711,665, 6,275,920, 
4,215,401, 4,739,474, 6,073,185, 5,809,322, 5,717,943, 
5,710,932, 5,546,343, 5,421,019, 5,134,711, 5,095,527, 
5,038,282, 6,049,859, 6,173,388, 5,752,068, 5,729,758, 
5,590,356, 5,555,428, 5,418,915, 5,175,858, 4,992,933, 



and 4,775,952. However, each one of these references 
suffers from one or more of the following disadvantages: 
(A) Not pin-compatible or function-compatible with a 
conventional random access memory; (B) Not able to be 
used in a memory unit of a conventional bus-sharing ar- 
chitecture; (C) Not able to accomplish tasks by itself of re- 
quired complexity for most common parallel problems 
such as sorting and sum; (D) requiring a lot reconfigura- 
tion effort when switching tasks; and (E) requiring re- 
designing of existing computer architectures. 
[0012] For the foregoing reasons, there is a need to build smart 
memories that is: (A) pin compatible with a conventional 
random access memory; (B) function compatible with a 
conventional random access memory; (C) comprising a 
SIMD (Single-Instruction Multiple-Data) processing archi- 
tecture inside; (D) requiring no or little external bus activ- 
ities to solve the parallel problem for which the smart 
memory is designed for; (E) switching between different 
tasks instantly, (F) variable in scope of capability; and (G) 

is practical to be implemented. 
Summary of Invention 

[0013] The present invention is directed to an apparatus that sat- 
isfies this need for a smart memory. This apparatus is 



called concurrent processing memory, or simply CP mem- 
ory. 

[0014] The CP memory is pin compatible with a conventional ran- 
dom access memory. It needs only difference of one extra 
pin, called a command input pin, from a conventional ran- 
dom access memory. The command input pin can actually 
be connected as an address pin as if the CP memory is a 
random access memory of a larger capacity. 

[0015] When the command input pin is negatively asserted, the 
CP memory behaves exactly lil<e a conventional random 
access memory, containing an array of addressable regis- 
ters for storing and retrieving data through an external 
bus comprising address bus, data bus and control bus. 

[0016] The CP memory is also a SIMD (Single-Instruction Multi- 
ple-Data) machine for solving parallel problems, contain- 
ing identical memory elements: (A) each of which prefer- 
ably comprises at least one addressable registers, possi- 
bly other registers, and some processing power, and (B) 
all of which can simultaneously execute a same instruc- 
tion independently from each other. The concurrent pro- 
cessing power means great reduction of the required in- 
struction cycles for parallel problems. The processing 
power within the CP memory means reduction, in most 



cases great reduction, of the need to use the external bus 
to transfer data. 

[0017] When the command input pin is positively asserted, the CP 
memory treats the content of the external bus as an in- 
struction. Since the command input pin is connected as a 
pin for address bus, to a user of the CP memory, sending 
instruction and getting result is like storing and retrieving 
data using a special address in a conventional random ac- 
cess memory. In this way, a CP memory can be used any- 
where a conventional random access memory can be 
used, including in any bus-sharing computer. 

[0018] A memory element of a CP memory only executes an in- 
struction when it is activated. The CP memory instantly 
activates all memory elements whose element addresses 
are: (A) no less than a start address, (B) no more than an 
end address, and (C) an integer increment of the carry 
number starting from the start address. In another word, 
the activated elements form a lattice that is instantly 
changeable. The lattice structure is analogous with the 
data array structure which is common to all parallel prob- 
lems. This guarantees quick task switching, no matter 
how many memory elements need to be activated or inac- 
tivated between tasks. 



[0019] The CP memory is actually a family name that comprises 
CP memories of various scopes, for solving different kinds 
of parallel problems. Among them, in the order of in- 
creased complexity of the memory element, are: (A) con- 
tent movable memory, (B) content searchable memory, (C) 
content comparable memory, (D) database memory, (E) ID 
math memory, and (F) 2D math memory. The content 
searchable memory and the content comparable memory 
are collectively referred as content matchable memory. 
The ID math memory and 2D math memory are collec- 
tively referred as math memory. 

[0020] The CP memory is constructed using standard digital cir- 
cuitry technology. Still, several device components of the 
CP memory have been invented also using standard digital 
circuitry technology, such as carry pattern generator, par- 
allel shifter, all-line decoder, parallel comparator, general 
decoder, range decoder, multi-channel multiplexer, and 

multi-channel demultiplexer. 
Brief Description of Drawings 

[0021] piQ I' Complex system structure of a complex CP Mem- 
ory. 

[0022] piQ 2: Connecting a CP memory to an external bus. 



[0023] piQ^ 3: Connecting two CP memories togetlier and to an 
external bus. 

[0024] piQ 4; Circuit diagram of a 3-digit 8-input/output parallel 
left shifter. 

[0025] piQ_ 5: Circuit diagram of a 3-input 8-output all-line de- 
coder. 

[0026] piQ^ Q- Logic for activating general decoder bit outputs. 

[0027] piQ 7; Structure diagram of a content movable memory el- 
ement. 

[0028] piQ^ Structure diagram of a content searchable memory 
element. 

[0029] piQ^ gi)-^ Structure diagram of a content comparable mem- 
ory element. 

[0030] piQ^ g- Circuit diagram of a 4-bit parallel comparator. 

[0031] piQ^ iQ- Symbols for standard and simplified multiple input 
AND gate. 

[0032] piQ^ II- Circuit diagram of a 4-bit parallel adder. 

[0033] piQ^ 12: Structure diagram of a 4-bit parallel counter using 
adders in binary tree construct. 

[0034] PIQ Circuit diagram of a 4-bit parallel adder for paral- 
lel counter. 

[0035] piQ^ 14- Circuit diagram of a 3-bit parallel counter using 



A/D technology. 

[0036] piQ J 5; Structure diagram of a 6-bit parallel counter 
scaled up from 3-bit parallel counters. 

[0037] iQ- Circuit diagram of an 8-input 4-channel multi- 
plexer. 

[0038] piQ^ Circuit diagram of an 8-output 4-channel demul- 
tiplexer. 

[0039] piQ^ Structure diagram of a memory element for math 
memory. 

[0040] piQ^ ig-^ General cases of disorder for global moving sort- 
ing algorithm. 
[0041] piQ^ 20: Algorithm flow diagram for 1-D sum. 

[0042] piQ^ 2l\ Algorithm flow diagram for 2-D sum. 

[0043] piQ^ 22\ Algorithm flow diagram for 1-D template match- 
ing. 

[0044] piQ^ 23: Algorithm flow diagram for 2-D template match- 
ing. 

[0045] piQ_ 24: (4 * 3) super lattice for detecting line with slope of 
(3/4). 

[0046] piQ^ 25a: A set of lines whose pixel spans are exactly 7 in 

walking distance. 
[0047] PIQ 25b: A set of lines whose pixel spans are about 5 in 



real distance. 
[0048] piQ^ 26: Log(N) long range connectivity. 

[0049] p/G. 27a: 2-D super-lattice connectivity. 

[0050] FIG. 27b: 3-D super-lattice connectivity. 

[0051] FIG. 28: Logic diagram of parallel divider. 

[0052] FIG. 29: Function diagram of a concurrent processing 

memory, which is the overview of the invention. 
Detailed Description 

Backward compatibility 

[0053] FIG. 1 shows a structure overview of a most complicated 
CP memory on the system level, which can be turned into 
other family members in the CP memory family by delet- 
ing components form it, as described later in this De- 
scription. 

[0054] Except a command bit input iOi, a CP memory has the 

same external bus connection 102 for an external bus as a 
conventional random access memory. The external bus 
comprises address bus, data bus, and control bus. 

[0055] The address bus is usually wider than a memory's external 
connection to address bus. For a conventional random ac- 
cess memory, the address bus bits which are not con- 



nected with the memory's external bus connection to the 
address bus are assigned address bits. Each memory has 
an assigned address which is unique for the memory. 
When the assigned address bits equals the assigned ad- 
dress, an enable bit input, which is one of the memory's 
external bus connection to control bus, is positively as- 
serted to activate the memory. For a CP memory, the least 
significant bit of the assigned address bits is connected to 
the command input bit of a CP memory, while the rest bits 
are assigned address bits. Thus, a CP memory requires 
twice of address space than what it contains in its ad- 
dressable registers. Other assigned address bit can also 
be connected to the command input bit of a CP memory, 
with a larger address space needed. 
[0056] The data bus is usually 2am fold byte wide, in which M is 
an unsigned integer, while each addressable register in- 
side a memory is often byte wide. If a memory's external 
connections to data bus are byte wide, the M least signifi- 
cant bits of the address bus select the byte portion of the 
data bus to be connected to the CP memory's external 
connection to data bus, using a multiplexer/demulti- 
plexer, in the same manner as a conventional random ac- 
cess memory. 



[0057] PIC 2 shows how a byte-wide CP memory 301 is con- 
nected with the address bus and the data bus of an exter- 
nal bus, whose data bus 310 is two-byte wide. The least 
significant portion 303 of the address bus 302 is connected 
to the memory's external bus connection to address bus. 
The next address bus bit 304 is connected with the mem- 
ory's command input bit. When the rest address bits 305 
contain a value that equals the assigned address 308 for 
the memory, the memory is activated through its enable 
bit input 307, which is one of the memory's external bus 
connections to control bus. The least significant bit 306 of 
the address bus 302, which is also connected to the mem- 
ory's external bus connection to the address bus, selects 
to connect either the lower portion 311, or the higher por- 
tion 312 of the data bus 310 to the memory's external bus 
connection to data bus3l4 through a multiplexer/de- 
multiplexer 313. 

[0058] The CP memory's external bus connections to the other 
bits of the control bus are the same as those of a random 
access memory. The control bus of an external bus pro- 
vides power and ground, instructs the memory for either a 
storing or a retrieving operation, and provides synchro- 
nization and handshake with other devices which are also 



connected to the same external bus. 
[0059] If the address space is not a concern, a CP memory may 
have more than one command bit to connect to the ad- 
dress bits, to increase the bandwidth of transferring in- 
structions. Some bus standards have dedicated control 
and arbitration bits to control the connected devices. Ac- 
cordingly, the CP memory may have additional command 

bits to take advantages of the situation. 
Exclusive Access 

[0060] In FIG. 1, when the command bit input lOi is negatively 
asserted, the CP memory behaves exactly like a conven- 
tional random access bus. The address bus of the external 
bus 102 specifies a register address for one of the ad- 
dressable registers i06 within the CP memory; the register 
address is sent to the input/output control unit 103, and 
then to the register control unit 104, which exclusively ac- 
tivates the corresponding addressable register at the reg- 
ister address through exclusive connections i07 to each of 
all the addressable registers. The control bus of the exter- 
nal bus 102 specifies either a storing operation or a re- 
trieving operation to the CP memory. For a storing opera- 
tion, the data is sent from the data bus of the external bus 
102 to the input/output control unit 103, then to the ex- 



elusive bus 105, and then to the exclusively activated ad- 
dressable register. For a retrieve operation, the data is 
sent from the exclusively activated addressable register, 
to the exclusive bus 105, then to the input/output control 
unit 103, and then to the data bus of the external bus 102. 
A CP memory may use the same logic and the same hard- 
ware for exclusive access as a random access memory. 
Concurrent Instructing 

[0061] The CP memory is also a SIMD machine, containing identi- 
cal memory elements 108, each of which preferably com- 
prises at least one addressable registers 106, possibly 
other registers, an enable bit inputiii, an optional match 
bit output 112, and some processing power. 

[0062] When the command bit input lOi is positively asserted, 
the CP memory treats the content of the external bus 102 
as an instruction. Since the command input pin 101 is 
connected as an address bus bit, to a user of a CP mem- 
ory, sending instruction and getting result is like storing 
and retrieving data with a conventional random access 
memory when a particular address bit is positively as- 
serted. Within CP memory, the instruction is then trans- 
lated by the input/output control unit 103, and broad- 
casted to all the memory elements 108 concurrently 



through a concurrent bus 109. In addition to instruction, 
the concurrent bus 109 may also broadcast data to all the 
memory elements 108. The concurrent bus 109 is exclu- 
sively written by the input/output control unit 103, and 
concurrently read by multiple memory elements 108. 

[0063] Each memory element 108 has a unique element address. 
The input/output control unit 103 sends a start address, 
an end address, and a carry number to a general decoder 
110, which, through enable bit inputs ill exclusively to 
each of all the memory elements 108, activates all the 
memory elements i08 whose element addresses are: (A) 
no less than the start address, (B) no more than the end 
address, and (C) an integer increment of the carry number 
starting from the start address. All the enabled memory 
elements receive and execute a same instruction with a 
same data parameter from the concurrent bus 109. The 
start address, end address, and carry number are all pa- 
rameters as part of instructions to the CP memory. 

[0064] As described later, the carry number needs not to exceed 
the square root of the total bit output count of the general 
decoder. For a content movable memory or a content 
searchable memory, it is a constant of 1. 

[0065] The data for majority parallel problems are in the format 



of array. Using the above activation rules, an item may be 
held by a same number of memory elements which have 
consecutive element addresses, or a memory element may 
hold a same number of items. For simplicity of the follow- 
ing discussion, each memory element may hold one item, 
and the other two cases can be treated similarly. 

[0066] It is possible that each of all bit outputs of the general de- 
coder is connected to a dedicated bit storage cell 115, 
such as a flip-flop, and the bit storage cell connects to the 
enable bit input of the corresponding memory element 
111. One use of the bit storage cell 115 is to separate the 
general decoder from active duty of activating memory el- 
ements when the general decoder no, parallel counter 
and priority encoder 113 are configured as a parallel di- 
vider, as described later. The other use of the bit storage 
cell 115 is to put additional constraint on the activation of 
memory elements, such as acting as a filter for a 2D im- 
age pattern which has irregular shape. 

[0067] Like a conventional static random access memory, the ex- 
ecution of an instruction by a CP memory may take the 
same amount of time as storing or retrieving data with an 
addressable register. Like a conventional dynamic random 
access memory, the execution of an instruction by a CP 



memory may take longer time, or even variable time, and 
the input/output control unit 103 may use standard asyn- 
chronous means for signaling the termination of instruc- 
tion execution, such as interrupt, wait states, or prede- 
fined content change of the external bus 102, or simply 
require a predefined wait period before receiving another 
instruction from the external bus 102. 
[0068] Each register inside a memory element is identified by a 
register number, so that it can be referred in an instruc- 
tion to the memory element. The assignment of register 
number satisfies the following conditions: (1) the set of 
register numbers is identical for all of the memory ele- 
ments; (2) the registers which have the same register 
number are functionally equivalent within their memory 
elements respectively, and (3) the register number for an 
addressable register is between zero and the value of one 
less than the count of the addressable registers within 
each memory element. Thus, the register address of each 
addressable register i06 comprises: (1) the element ad- 
dress of the memory element i08 which contains the ad- 
dressable register 106\ and (2) the register number to 
identify the addressable register i06 within the memory 
element. If the register number is used as the lower por- 



tion for the register address, all functionally equivalent 

registers within all memory elements form a continuous 

register address range, which is convenient for task 

switching such as using direct memory access. 
Concurrent Matching 

[0069] Each activated memory element 108 of a CP memory can 
have internal states. If the internal state matches a re- 
quirement, which may have been sent to the memory ele- 
ments by the concurrent bus 109, the memory element 
positively asserts its match bit outputii2 exclusively to a 
priority encoder 113, which outputs to the input/output 
control unit 103 either the highest or the lowest element 
address of the memory element which is in the required 
state. The priority of the priority encoder is controlled by 
the input/output control unit 103. Alternatively, each 
match bit outputii2 for the memory element may exclu- 
sively connect to a parallel counter 113, which outputs the 
total count of the memory element which is in the 
matched state to the input/output control unit 103. Both 
priority encoder and parallel counter may also be used. 

[0070] Each memory element may have a storage bit to save the 
binary value of the match bit output, so that it can be 
used for subsequent state definition, or state definition 



which involves neighboring memory elements. 
Local Connectivity 

[0071] jhe physically neighboring memory elements have adja- 
cent element addresses. In a one-dimensional CP mem- 
ory, except the two boundary memory elements, each of 
which has either lowest or highest element address, each 
of all the memory elements has two neighboring memory 
elements whose element address is either immediately 
lower or immediately higher than the element address of 
the memory element itself. In a two-dimensional CP 
memory, each memory element is on the node of a square 
lattice; the two perpendicular lattice directions are the X 
and the Y directions; the element address is partitioned 
into X and Y addresses; and except boundary memory el- 
ements; each of all memory elements has a pair of neigh- 
boring memory elements along the X direction, and an- 
other pair of neighboring memory elements along the Y 
direction. 

[0072] The neighboring memory elements may be connected 

through neighborhood connection 114 so that each mem- 
ory element shows a universal content of at least one of 
its registers, which is called the neighboring register, to 
all of its neighbors. 



[0073] A CP memory may contain additional external connections 
to the neighboring registers of the boundary memory, so 
that several CP memories can be connected and used as 
one large CP memory. FIG. 3 shows how to connect two 
CP memories together, each of which has been connected 
to an external bus as described in FIG. 2, using the addi- 
tional external connections to the neighboring registers of 

the boundary memory elements 315 
Instruction Kernel 

[0074] A CP memory is controlled by the external bus, which is 
connected and controlled by the processing unit of a 
computer. An instruction kernel may interface between a 
CP memory and an external bus, to translate instructions 
for the instruction kernel into instructions for the CP 
memory, not unlike translating the instructions for a pro- 
cessor into micro-kernel instructions within the proces- 
sor. The instruction kernel could be: (1) an instruction 
kernel inside the input/output unit of the CP memory, (2) 
an embedded microcontroller between the CP memory 
and the external bus, or (3) a software driver that man- 
ages the CP memory. 

[0075] The instructions for the instruction kernel are more com- 
plex, and probably more capable than the instructions for 



the memory elements. For an example, In math memory, 
the multiplication and division Instructions for the In- 
struction kernel may be translated into a series of addi- 
tion, subtraction, and shifting Instructions for the memory 
elements. The instruction kernel may contain resources 
such as memory, registers, and/or accumulator to carry 
out the instructions. The instructions for the instruction 
kernel may be carried out asynchronously, and the in- 
struction kernel may use a predefined wait time period, a 
wait state of the data bus, an interrupt, or other means, to 

signal the end of such an Instruction execution. 
General Decoder 

[0076] As described earlier, the general decoderiiO has a carry 

number Input, a start address Input, an end address Input, 
all of which from the Input/output control unit 103, and a 
plurality of element control bit outputs ill, each of which 
connecting exclusively to the enable bit Input of a unique 
memory element 108. The element address of each mem- 
ory element 108 is actually decided by the general decoder 
110. 

[0077] Inside the general decoderiiO, the carry number input is 
connected to a carry pattern generator, which positively 
asserts all its bit outputs whose addresses are an incre- 



ment of the inputted carry number while negatively as- 
serting all the other bit outputs. All possible values of the 
carry number form a set C. A bit output D has an address 
A, whose binary expression is C(A), and whose natural 
number factors forming another set Q(A). K(A) is the over- 
lap set between C and Q(A). Using K(A)[k] to denote a 
unique element of K(A), the logic expression of D[A] is: 
[0078] D[0] = 1; 

[0079] IF A G K[A]: D[A] = I D[K(A)[k]] + C(A); 

k 

[0080] ELSE: D[A] = I D[K(A)[k]]; 

k 

[0081] The above expression is transformed into standard prod- 
uct-of-sum format using either K-map or Quine-Mc- 
Cluskey method, and the carry pattern generator is con- 
structed using corresponding two-level gates. The prod- 
uct-of-sum construct is chosen for expansibility, so that 
the addition of C[M] input bit appends IC[M] product term 
to the existing expressions of (C[M-1] ... C[0]). For an ex- 
ample, a 3/8 carry pattern generator inputs binary carry 
number (C[2] C[l] C[0]), and outputs bit outputs (D[7] D[6] 
D[51 D[4] D[3] D[21 D[l] D[0]) in the following manner: 

[0082] D[0] = 1; 

[0083] D[l] = IC[2] IC[11 C[0]; 



[0084] D[2] = !C[2] C[l] !C[0] + D[l]; 

[0085] D[3] = !C[2] C[l] C[0] + D[l]; 

[0086] D[4] = C[2] !C[1] !C[0] + D[2] + D[l]; 

[0087] D[5] = C[2] !C[1] C[0] + D[l]; 

[0088] D[6] = C[2] C[l] !C[01 + D[3] + D[2] + D[l]; 

[0089] D[7] = C[2] C[l] C[0] + D[l]; 

[0090] Or: 

[0091] D[0] = 1; 

[0092] D[l] = !C[2] !C[1] C[0]; 

[0093] D[21 = !C[2] (C[l] + C[0])(!C[1] + !C[0]); 

[0094] D[3] = !C[2] C[0]; 

[0095] D[4] = (C[2] + C[l] + C[0])(!C[2] + !C[1])(!C[1] + 

!C[01)(!C[2] + !C[01); 

[0096] D[5] = !C[11 C[01; 

[0097] D[6] = (!C[2] + !C[0])(C[1] + C[0]); 

[0098] D[7] = (!C[2] + C[1])(C[2] + !C[1]) C[0]; 

[0099] The bit outputs of the carry pattern generator D = (D[N-1] 
... D[0]) are connected to the bit inputs of a parallel left 



shifter, whose shift amount input S = (S[l\/I-1] ... S[0]) is 
connected from the start address input to the general de- 
coder 110. The parallel left shifter concurrently shifts all 
bit inputs D = (D[N-1] ... D[0]) toward higher address by 
the amount of shift amount input S at its bit outputs H = 
(H[N-1] ... H[0]), mathematically as: 
[0100] |FA=> S: H[A] = D[A-S]; 

[0101] ELSE: H[A] = 0; 

[0102] Since shifting is accumulative, each S\j] input bit just 

shifts each of all the inputs by the amount of 2Aj toward 
higher address. For an example, the circuit diagram of a 
3/8 parallel left shifter is shown in FIG. 4, in which (D[7] 
... D[l] D[0]) is the 8-bit input, (H[7] ... H[l] H[0]) is the 
8-bit output, and (S[2] S[l] S[0]) is the 3-bit shift amount 
input. The circuit diagram is readily to be extended when 
the bit count of inputs and outputs is more than 8. 

[0103] Inside the general decoderiJO, the end address input is 
connected to the address input E = (E[M-1] ... E[0]) of an 
all-line decoder, which activates all its bit outputs F = 
(F[N-1] ... F[0]) whose address is less than or equal to the 
input address. For an example, a 3/8 all-line decoder in- 
puts 3-bit address (E[2] E[l] E[0]), and outputs 8-bit bit 



outputs (F[7] ... F[l] F[0]) in the following manner: 
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[0120] F[0] = E[2] + 1; 

[0121] The corresponding circuit diagram is displayed in FIG. 5. 
Assuming the bit output is F[E, N], in which N denotes the 
bit width of the address input and E denotes the address 
of the bit output, an all-line-decoder with input address 
bit width of (N + 1) can be built from an all-line-decoder 
with input address bit width of N using the logic expres- 
sion of F[E, N]: 

[0122] F[0, 1] = 1; 

[0123] F[l, 1] = E[01; 

[0124] F[(0 E[N-1] ... E[0]), N+1] = F[(E[N-1] ... E[0]), N] + E[N]; 

[0125] F[(l E[N-1] ... E[0]), N+1] = F[(E[N-1] ... E[0]), N] E[N]; 

[0126] Inside the general decoder no, the bit outputs of the par- 
allel left shifter H = (H[N-1] ... H[0]) are AND-combined 
with the corresponding bit outputs of the all-line decoder 
F = (F[N-1] ... F[0]), to become the corresponding bit out- 
puts of the general decoder no, as illustrated in FIG. 6. All 
the element control bit outputs are activated 123 whose 
element addresses are: (A) no less than a start address 
121, (B) no more than an end address 122, and (C) an inte- 
ger increment of the carry number starting from the start 



address 120. 

[0127] As described later, the value of the carry number input 
needs not exceed the square root of the total bit output 
count of the general decoder. 

[0128] If the carry number is a constant of 1, the start address is 
input into a first all-line decoder whose outputs are nega- 
tively assertive, and the end address is input into a second 
all-line decoder whose outputs are positively assertive. 
The corresponding outputs from the two all-line decoders 
are AND-combined, before becoming the bit outputs of 
the general decoder no. This special case of general de- 
coder is called a range decoder. 

[0129] Due to the design of the general decoder no, changing its 
start address input may be less efficient than changing its 
end address input in terms of the number of gates that 
need to change their states. 

[0130] It is possible to enable each memory element by the bit 
storage cell only (without using the general decoder), like 
conventional processor array. Other means then is used to 
setting the values of the bit storage cell serially, such as 
using a controlling CPU. However, this method may be 
slow for task switching between different array or differ- 
ent members of array items of a same array. Thus, general 



decoder or range decoder also may be very useful in con- 
trolling processor array in general. 
Content Movable Memory 



[0131] The simplest CP memory is a content movable memory. 
FIG. 7 shows its memory element 108. Each memory ele- 
ment 108 has only one addressable register 106, thus the 
element address is same as the register address of the 
addressable register 106. Through neighborhood connec- 
tion 114, the addressable register 106 is also the neigh- 
boring register. The memory element has another regis- 
ter, the operation register 200, which is made of cheap 
dynamic memory cells that only need to keep their values 
for more than one clock cycles. A multiplexer 212 selects a 
neighborhood connection, either (A) from the memory el- 
ement which has immediately lower element address ll4a 
or (B) from the memory element which has immediately 
higher element address ll4b, to copy to the operation 
register 200 when the write control bit 244 of the operation 
register 200 is positively asserted. The value of the opera- 
tion register 200 can be copied to the addressable register 
i06 when the write control bit 243 of the addressable reg- 
ister 106 is positively asserted. The concurrent bus 109 has 
two bits, one 241 to select the source of the multiplexer 



212 from either ll4a or ll4h, the other 242 to select copy- 
ing to one of the two registers, 200 or 106. The enable bit 
inputJlJ is AND combined with the other bit 242 of the 
concurrent bus 109, to disable any copying when the en- 
able bit input 111 is negatively asserted. Thus, the control 
unit of the memory element 108 comprises the connec- 
tions of the multiplexer 212, the AND gate for the write 
control bit 243 of the addressable register 106, the AND 
gate for the write control bit 244 of the operation register 
200, and the enable bit inputJii. 
[0132] The content of addressable registers 106 in the neighbor- 
ing memory elements can be copied to the addressable 
register 106 by first being copied through the neighbor- 
hood connection ll4a or ll4b to the operation register 
200, and then to the addressable register i06 of the mem- 
ory elements. 

[0133] A content movable memory needs neither priority encoder 
nor parallel counter 113. A range decoder is used as the 
general decoderiJO, so that all the memory elements are 
activated if their element address is: (A) no less than a 
start address, and (B) no more than an end address. In 
this way, the data within a register address range can be 
moved within a content movable memory. 



[0134] Using the contenting moving procedure, a content mov- 
able memory can add, remove, relocate, and change size 
of a stored data object anywhere within it while keep its 
content closely packed. It may contain a truly dynamic ar- 
ray without the need for either link list or look-ahead al- 
location. It may even use address independent unique ID 
to identify each stored data objects, and support contain- 
ment relationship so that: (A) when the size of a contained 
data object is changed, the container data object is 
changed accordingly, and (B) when the container data ob- 
ject is removed, all the contained data objects are re- 
moved. 

[0135] When using a content movable memory for a program, the 
space allocated for a variable can grow and shrink easily 
according to the need, which brings about the following 
advantages: (1) a numerical variable will never go out of 
range, (2) an array is always dynamic; (3) the distinction 
between stack memory and heap memory may no longer 
need, and (4) the most economical use of the resources 
can be achieved. 

[0136] Since both size and precision for each numerical variable 
is adjustable dynamically, the conventional float fractional 
formats and their rules of operations can be improved so 



that the precision error is always limited to the LSB (least 
significant bit) of the mantissa. For an example, the result 
precision of an addition or subtraction is the lesser preci- 
sion of the two operands, and in case the two operands 
having same precision, the result precision remains in the 
original LSB if the two operands are independent from 
each other, and the operation on the original LSBs does 
generate carry, or it is shifted to the bit immediately 
above the original LSB if otherwise. The multiplication, di- 
vision, and other arithmetic operations can be based upon 
similar rules for addition and subtraction. In such a 
scheme, each numerical value is guaranteed to be precise 
until LSB. In worst case, instead of giving wrong answer 
due to precision error accumulation and propagation as in 
the conventional float fractional math, the new float frac- 
tional math may indicate that at a certain step of the algo- 
rithm, the initial values are no longer precise enough for 

the algorithm. 
Content Matchable Memories 

[0137] Content matchable memory is also a family name. It has 

three types of memory element: 
[0138] (1) content searchable memory element, which can match 

the content of its addressable register i06With a datum, 



and positively assert its match bit output 112 if (I) its en- 
able bit input 111 is positively asserted, and (II) the com- 
parison satisfies the match requirement, which can be any 
of: (A) equal, and (B) unequal. Neighborhood connection 
allows comparison between a datum and the collective 
content of any neighboring memory elements. Thus, the 
primary use is to find all matching strings among a text. 

[0139] (2) content comparable memory element, which can com- 
pare the content of its addressable register i06With a da- 
tum, and positively assert its match bit output ii2if (I) its 
enable bit input ill is positively asserted, and (II) the 
comparison satisfies the match requirement, which can be 
any of: (A) equal, (B) unequal, (C) larger, (D) smaller, (E) 
larger or equal, and (F) smaller or equal. Neighborhood 
connection allows comparison between a datum and the 
collective content of neighboring memory elements which 
forms the items of an array. Thus, the primary use is to 
find all matching array items. 

[0140] (3) It is also possible to combine either a content search- 
able memory element or a content comparable memory 
element with a content movable memory element. 

[0141] FIG. 8a shows a content searchable memory element 108. 
It has only one addressable register 106, whose content is 



to be searched. The concurrent bus 109 sends: (A) a mask 

204, which is AND combined with the addressable register 
106 at a bus AND gate 261; (B) the datum to be matched 

205, whose value is compared with the masked data from 
the output of the AND gate 261 at a comparator 211, which 
composed of a bus XOR gate and a OR gate; and (C) the 
instruction 207, which contains the requirement of match- 
ing. The mask 204 of the concurrent bus 109, and the AND 
gate 261 are optional, and the addressable register 106 
may be compared directly with the datum to be matched 
205 of the concurrent bus 109 at the comparator 211. The 
bit output of the comparator is positively asserted if the 
masked datum at the addressable register i06 differs from 
the datum to be matched 205 at any bit, which is the 
"case" of the comparison. The instruction 207 portion of 
the concurrent bus i09 contains a "condition" code bit 252, 
which is compared with the "case" of the comparison at a 
XOR gate 260, whose bit output is positively asserted if the 
"case" does not equals the "code". The bit output from the 
XOR gate 260 is AND combined with the enable bit input 
111 at an AND gate 262 whose output asserts the match 
bit output 112 of the memory element 108. 

[0142] Additional logic allows the value matching across memory 



elements when neighboring elements to be matched to- 
gether. Instead of directly connecting to the AND gate 262, 
the bit output from the XOR gate 260\s connected to an 
AND gate 263, to be saved into a one-bit neighboring reg- 
ister 201, whose write control bit is connected to the en- 
able bit input iiiof the memory element 108, and whose 
bit output is connected to the AND gate 262which drives 
the match bit output 112 of the memory element 108. The 
one-bit neighboring register 201 is connected to the 
neighboring memory elements through neighborhood 
connection 114. The concurrent bus 109 sends one more 
instruction bit "self 253 with the instruction portion 207 of 
the concurrent bus 109. Through an OR gate 264, when the 
instruction bit "self" 253 is positively asserted, the match 
bit output 112 is positively asserted when a match is found 
by the XOR gate260; otherwise, the neighborhood connec- 
tion from the memory element whose element address is 
higher ii4ba.\so has to be positively asserted to positively 
assert the match bit output 112. Assuming the width of 
the addressable register 106 of each of all the memory el- 
ements is byte, an algorithm for a search of a string is the 
following: 

[0143] (1) Match for equal the addressable register i06with the 



highest byte of the value, while positively asserting the in- 
struction bit "self 253; 
[0144] (2) In the order from high to low, match for equal the ad- 
dressable register i06 with the corresponding byte of the 
value, while negatively asserting the instruction bit "self" 

253] 

[0145] (3) jhe memory elements whose match bit outputs are 
positively asserted are the memory elements which have 
the smallest element addresses of neighboring memory 
elements which hold the string to be searched. 

[0146] Similar construct can be built for the algorithm to match 
for equal in the order from low to high, or from both di- 
rections. 

[0147] FIG. 8b shows a content comparable memory element 108. 
It has only one addressable register 106, whose content is 
to be compared. The concurrent bus 109 sends: (A) a mask 

204, which is AND combined with the addressable register 
i 06 at a bus AND gate 261] (B) the datum to be compared 

205, whose value is compared with the masked datum 
from the output of the AND gate 261 at a comparator 211; 
and (C) the instruction 207, which contains the require- 
ment of comparison. The mask 204 of the concurrent bus 
109, and the AND gate 261 are optional, and the address- 



able register 106 may be compared directly with the datum 
to be compared 205 of the concurrent bus 109 at the com- 
parator 211. The "=" and ">" outputs of the comparator 
211 is the "case" of comparing the masked value of the 
addressable register i06 and the datum to be compared 
205, while the first three bits 250 to 252 of the instruction 
207 portion of the concurrent bus i09 contains the "condi- 
tion" code of the match requirements. A matching logic 
table260 of standard two-layer logic combines the "case" 
and the "condition", to positively assert its output if the 
"case" matches the "condition", as demonstrated by the 
following function table for the match output from the 
matching logic table260: 
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[0148] The bit output from the matching logic table 260 is AND 
combined with the enable bit input iiiat an AND gate 262 
whose output asserts the match bit output 112 of the 
memory element 108 



[0149] Additional logic allows the value matching across memory 
elements when each of the items to be matched spans 
several neighboring elements. Instead of directly connect- 
ing to the AND gate 262, the bit output from the matching 
logic table 260\s connected to an AND gate 263, to be 
saved into a one-bit neighboring register 201, whose write 
control bit is connected from the enable bit input ill of 
the memory element 108, and whose bit output is con- 
nected to the AND gate 262 which drives the match bit 
output 112 of the memory element 108. The one-bit 
neighboring register 201 is connected to the neighboring 
memory elements through neighborhood connection 114. 
The concurrent bus 109 sends three more instruction bits: 
"self" 253, "transfer" 254, and "select" 255, with the in- 
struction 207 portion of the concurrent bus 109. When the 
instruction bit "select" 255 is positively asserted, the 
neighborhood connection from the memory element 
whose element address is immediately higher ll4b is se- 
lected to the output of a multiplexer 265; otherwise, the 
neighborhood connection from the memory element 
whose element address is immediately lower ll4a is se- 
lected. Through an OR gate 264, when the instruction bit 
"self" 253 is positively asserted, the output of the AND 



gate 263 is positively asserted wlien a matched is found by 
tlie matching logic table 260; otherwise, the output of the 
multiplexer 265 also has to be positively asserted to posi- 
tively assert the output of the AND gate 263. Through a 
multiplexer 266 and a AND gate 267, when the instruction 
bit "transfer" 254 is positively asserted, and the neighbor- 
ing register 201 is also positively asserted, the output of 
the multiplexer 265 is saved into the neighboring register 
201] otherwise, the output of the AND gate 263 is saved 
into the neighboring register 201. 

[0150] For simplicity of discussion: (A) the bit width of the ad- 
dressable register 106 in each memory element is byte; (B) 
each item contains M neighboring memory elements, 
which are denoted as (M-l)th to 0th in the order of from 
high to low in element address containing (M-l)th to 0th 
significant bytes of the value of the item; (C) the value to 
be matched is a M-byte unsigned value; and (D) the action 
of setting the general decoder iiO accordingly is omitted, 
which is somewhat obvious. 

[0151] An algorithm for an equal matching is the following: 

[0152] (1) For all the (M-l)th memory elements of all the items, 
match for equal the addressable register i06 with the 
(M-l)th significant byte of the value, while: (A) positively 



asserting the instruction bit "self 253; and (B) negatively 
asserting tlie instruction bit "transfer" 254. Step (1) posi- 
tively asserts the neighboring registers 201 of all the 
(M-l)th memory elements when each of their addressable 
registers 106 has value equal to the (M-l)th significant 
byte of the value to be matched. 
[0153] (2) Letting j be (M-2), for all the jth memory elements of 
all the items, match for equal the addressable register 106 
with the jth byte of the value, while: (A) negatively assert- 
ing the instruction bit "self" 253; (B) negatively asserting 
the instruction bit "transfer" 254; and (C) positively assert- 
ing the instruction bit "select" 255;. Step (2) positively as- 
serts the neighboring registers 201 of each of all the jth 
memory elements when: (A) the addressable register 106 
has value equal to the jth significant byte of the value to 
be matched, and (B) the neighboring memory element of 
(i+l)th significance has positively asserted neighboring 
register 201. 

[0154] (3) Repeat step (2) with j decreased from (M-2) to 0. Step 
(3) positively asserts the neighboring registers 201 of the 
consecutive memory elements of each of all the array 
items whose addressable registers i06 all have values 
equal to the corresponding bytes of the value to be 



matched from highest significance. 

[0155] (4) The array items which equal the value to be matched 
have their neighboring registers 201 of 0th memory ele- 
ments positively asserted. 

[0156] An algorithm to compare the value of all the array items 
with a value to be matched for a requirement other than 
(A) equal, or (B) unequal, is the following: 

[0157] (1) For all the (M-l)th memory elements of all the items, 
match for equal the addressable register i06 with the 
(M-l)th significant byte of the value, while: (A) positively 
asserting the instruction bit "self 253] and (B) negatively 
asserting the instruction bit "transfer" 254. Step (1) posi- 
tively asserts the neighboring registers 201 of all the 
(M-l)th memory elements when each of their addressable 
register 106 has value equal to the (M-l)th significant byte 
of the value to be matched. 

[0158] (2) Letting j be (M-2), for all the jth memory elements of 
all the items, match for equal the addressable register 106 
with the jth byte of the value, while: (A) negatively assert- 
ing the instruction bit "self 253; (B) negatively asserting 
the instruction bit "transfer" 254; and (C) positively assert- 
ing the instruction bit "select" 255;. Step (2) positively as- 
serts the neighboring registers 201 of each of all the jth 



memory elements when: (A) the addressable register 106 
has value equal to the jth significant byte of the value to 
be matched, and (B) the neighboring memory element of 
(j + l)th significance has positively asserted neighboring 
register 201. 

[0159] (3) Repeat step (2) with j decreased from (M-2) to 1. Step 
(3) positively asserts the neighboring registers 201 of the 
consecutive memory elements of each of all the array 
items whose addressable registers i06 all have values 
equal to the corresponding bytes of the value to be 
matched from highest significance. 

[0160] (4) For all the 0th memory elements of all the items, 

match for the requirement the addressable register 106 
with the 0th significant byte of the value to be matched, 
while: (A) positively asserting the instruction bit "self 253; 
and (B) negatively asserting the instruction bit "transfer" 
254. Step (4) positively asserts the neighboring registers 
201 of the 0th memory elements when the addressable 
register 106 has value satisfying the match requirement 
with the 0th significant byte of the value to be matched. 

[0161] (5) Letting j be 1, for all the jth memory elements of all 

the items, match for the requirement the addressable reg- 
ister J06with the jth byte of the value to be matched. 



while: (A) positively asserting the instruction bit "self 253; 
(B) positively asserting the instruction bit "transfer" 254; 
and (C) negatively asserting the instruction bit "select" 
255. When a neighboring register 201 is originally posi- 
tively asserted, it is filled with the value of the neighbor- 
ing register 201 from the neighboring memory element of 
(j-l)th significance; otherwise, it is positively asserted 
when the addressable register 106 has value satisfying the 
match requirement with the jth significant byte of the 
value to be matched. 
[0162] (5) Repeat Step (5) with j increased from 1 to (M-1). At 
last, the match bit outputs ii2 from the (M-l)th memory 
elements of all the items are positively asserted when the 
array item which is held by neighboring memory elements 
matches the value to be matched according to the re- 
quirement. 

[0163] The above algorithm can be extended easily to array each 
item of which contains memory elements whose address- 
able registers 106 have width other than byte, or whose 
content significance is in reverse order with the element 
address, or matching signed values. 

[0164] Instead of comparing the value of a register and a value to 
be matched on the concurrent bus 109, it is also possible 



the matching is between two addressable registers 106 
within each memory elements. 
[0165] When the content of the enabled memory elements are 

distinguished, content matchable memory has three ways 
to collect the positively asserted match bit outputs 112 
using: 

[0166] (1) a priority encoder 113 to find either the highest or the 
lowest element address of the match bit outputs 112 
which have been positively asserted. 

[0167] (2) a parallel counter 113 to count the match bit outputs 
ii2which have been positively asserted. 

[0168] (3) the combination of (1) and (2). 

[0169] An algorithm for enumerating matched array items is: 

[0170] (1) Assert positively the match bit outputs 112 of all the 

matched items concurrently. 
[0171] (2) Set the priority of the priority encoder 113 to be from 

high to low. 

[0172] (3) If the no-hit bit output of the priority encoder ll3\s 

positively asserted, all the matched items have been enu- 
merated, and the enumerating algorithm should be termi- 
nated. 

[0173] (4) Read the address output of the priority encoder 113, 



which contains the highest element address of the 
matched item between the start address and the end ad- 
dress. 

[0174] (5) Set the end address to the item whose element address 
is immediately lower than that of the item which has been 
found in step (4). 

[0175] (5) Repeat step (3) to step (5). 

[0176] It is easy to design an alternative algorithm similar to the 
above algorithm based on the low-to-high priority of the 
priority encoder 113. Due to the design of the general de- 
coderiiO, changing its start address input may be less ef- 
ficient than changing its end address input. 

[0177] An algorithm for counting matched array items is: 

[0178] (1) Assert positively the match bit outputs 112 of all the 
matched items concurrently. 

[0179] (2) Read the count output of the parallel counter 113, 
which contains the count of the matched memory ele- 
ments. 

[0180] An algorithm to construct a histogram of M sections is: 
[0181] (1) Designate a variable CNT.HIGH. 
[0182] (2) Designate a variable CNT.LOW. 



[0183] (3) Match for smaller all the items with the upper limit of 
the smallest section. 

[0184] (4) Read the count output of the parallel counter 113 into 
CNT.LOW, which contains the histogram count of the 
smallest section. 

[0185] (5) Let j be 1, match for smaller all the items with the up- 
per limit of the jth section. 

[0186] (5) Read the count output of the parallel counter 113 into 
CNT.HIGH. 

[0187] (7) Subtracting CNT.LOW from CNT.HIGH to obtain the 

histogram count of the jth section. 
[0188] (8) Copy CNT.LOW from CNT.HIGH. 

[0189] (9) Repeat Step (5) to (8) for j from 2 to (M-1). 

[0190] (10) Subtracting CNT.HIGH from the total count of the 

items to obtain the histogram count of the largest section. 

[0191] The histogram of the data can be used to estimate the 
sum and the distribution of the data. 

[0192] It is possible that the concurrent bus 109 sends no in- 
struction 207, and the matching is done in a predefined 
manner, such as (A) always searching for equal between 
the content of the addressable register 106 of each of all 
the enabled memory elements and the condition datum 



205 of the concurrent bus 109, or (B) always searching for 
equal between the contents of two addressable registers 
106 of each of all the enabled memory elements. The use- 
fulness of such arrangement is limited. 
Parallel Comparator 

[0193] Jo facilitate quick value comparison, a parallel comparator 
may be used as the comparator 211 in the memory ele- 
ments 108. An example of 4-bit parallel comparator is 
shown in FIG. 9. A parallel comparator inputs two num- 
bers, X = (X[2AN-1] ... X[0]), and Y = (Y[2an-1] ... Y[0]), in 
which X|j] and Y|j] denote the jth significant bit of the in- 
put numbers of bit width 2an. When X and Y are equal, 
the parallel comparator positively asserts its equal bit 
output "X = Y". Otherwise, it positively asserts its larger 
bit output "X > Y" when X is larger than Y, or negatively 
asserts the larger bit output "X > Y" when X is smaller 
than Y, and outputs the largest bit significance of the X 
and Y difference at its address output A = (A[N-1] ... 
A[0]), in which A|j] denotes the jth significant bit of the 
address A of bit width N. In the first step, each pair of X|j] 
and Y|j] are compared to obtain G|j] and L[j], which are 
positively asserted when X|j] > Y|j] and X|j] < Y|j] respec- 
tively, as: 



[0194] GUI = X|j] lYUl; 

[0195] LUI = !X[jl Y[j]; 

[0196] In the second step, the corresponding bits of G and L are 
OR-combined to obtain the exclusive-OR combination Z|j] 
of XU] and Y|j], as: 

[0197] ZUl = GUI + LUI; 

[0198] In the third step, each of all the bits of Z is connected to 
the input bit of an encoder 271 of high-to-low priority 
with the bit's significance in Z being the same as the input 
bit's address of the encoder 271, the address at the ad- 
dress output (A[N-1] ... A[0]) of the encoder 271 thus con- 
tains the most significance of the bit at where X and Y dif- 
fers, and the no-hit bit output of the encoder 271, which 
is the equal bit output "X = Y" of the parallel comparator, 
is positively asserted when X and Y are equal. 

[0199] In the forth step, the address output of the encoder is 

connected to the address input of a multiplexer 272. Each 
of all the bits of G is connected to the input bit of the 
multiplexer with the bit's significance in G being the same 
as the input bit's address, so that the bit output of the 
multiplexer 272, which is the larger bit output "X > Y" of 
the parallel comparator, is positively asserted when X is 



larger than Y, or negatively asserted when X is smaller 

than Y. 
Parallel Adder 

[0200] A parallel adder adds two numbers X and Y into a number 
S in two steps: 

[0201] (1) Adds all corresponding bits of X and Y simultaneously 
without considering carrying over from other bits. Let n 
denote the nth bit, Z denote the bitwise XOR combination 
of X and Y, and C denote the carry number: 

[0202] z[n] = X[n] XOR Y[n] = (X[n] + Y[n]) !(X[n] Y[n]); 

[0203] c[n] = X[n-1] Y[n-1], with C[0] as carry input; 

[0204] IF z[n-l] = 1 THEN C[n] = 0; IF C[n] = 1 THEN Z[n-1] = 0; 

[0205] (2) Adds the Z and C into S. Let denotes a continu- 

ous 1 of bits of any length, and let "?" denotes an un- 
known value, the general cases for adding any fragment 
of Z and C bits is: 
Parallel addition cases 



Case 


1 


II 


Ill 


IV 


z 


0 


00...0 


01. ..10 


01... 10 


c 


0 


1...10 


0...01? 


0...00? 


s 


? 


1...1? 


10... 0? 


01...1? 



[0206] Case I and II show that whenever Z[n] is 0, there is no 

carry over beyond this bit. Case III and IV shows how carry 
is generated. The general equations for the sum S are: 

[0207] A[nJ] = C[n-j]n ^ Z[n-k]; 

k= 1 to J 

[0208] A[n] = Z. , A[n, j]; 

j=l to n 

[0209] s[n] = !Z[n] C[n] + Z[n] !C[n] !A[n] + !Z[n] A[n]; 

[0210] The equation of A[n] defines the carry look-ahead logic of 
the parallel adder, which can be implemented by an OR 
gate which adds the outputs from a series AND gate, each 
of which implements an A[n, j] of a different j. Due to 
large number of inputs, simplified AND and OR gate sym- 
bols are used, which are commonly used for transmission 
gate logic. FIG. 10 shows the examples of the standard 
and simplified three-input AND gate symbol. FIG. 11 
shows an example of a 4-bit parallel adder. 

[0211] A by-product of the above parallel adder implementation 

is the outputs for the bitwise AND, OR, and XOR outputs 

of X and Y. 
Parallel Counter 



[0212] As described earlier, either a priority encoder or a parallel 
counter or both may be used in concurrent matching op- 
erations. A priority encoder is a standard device. A parallel 



counter concurrently counts the bit inputs wliich are posi- 
tively asserted simultaneously and outputs the count at its 
output. An N-bit parallel counter has 2an bit inputs and 
N-bit output. 

[0213] A parallel counter can be constructed using parallel 
adders in binary tree construct, in which each parallel 
adder counts two inputs to its output at each tree node. 
The binary tree construct is made of layers of notes of 
same parallel adders. The jth layer contains 2A(N-j) j-bit 
parallel adders, each of which adds two j-bit inputs X = 
(X|j] ... X[0]) and Y = (Y[j] ... Y[0]) from the previous layer, 
and outputs (j+l)-bit output S = (S|j+1] S|j] ... S[0]) to the 
next layer. FIG. 12 shows the binary tree construct of a 
4-bit parallel counter comprising 16 bit inputs, a 1st layer 
151 of 8 1-bit parallel adders, a 2nd layer 152 of 4 2-bit 
parallel adders, a 3rd layer 153 of 2 3-bit parallel adders 
and a 4th layer 154 of 1 4-bit parallel adders. 

[0214] In the following tables, the item at the first column of the 
first row marks the layer number, the first row contains 
the values for X, the first column contains the values for Y, 
and the rest items contains the corresponding bit output 
of the parallel adder: 
1st layer 1-bit adder 



(1) 


0 


1 


0 


00 


01 


1 


01 


10 


2nd layer 2-bit adder 


(2) 


00 


01 


10 


00 


000 


001 


010 


01 


001 


010 


oil 


10 


010 


oil 


100 


3rd layer 3-bit adder 


(3) 


000 


001 


010 


oil 


100 


000 


0000 


0001 


0010 


0011 


0100 


001 


0001 


0010 


0011 


0100 


0101 


010 


0010 


0011 


0100 


0101 


0110 


oil 


0011 


0100 


0101 


0110 


0111 


100 


0100 


0101 


0110 


0111 


1000 



[0215] As a general rule, when the (j+l)th bit output is positively 
asserted for aj-bit parallel adder in ajth layer, its other 
bit outputs are negatively asserted. There is also no carry 
bit input. Thus, the parallel adders on each node of the 
binary tree of the parallel counter can be simplified ac- 
cordingly by: (A) removing the carry look-ahead logic for 
the most significant bit; and (B) starting the carry look- 
ahead logic from the 1st bit. FIG. 13 shows such a 4-bit 



parallel counter. 
[0216] An alternative way for constructing a small-scale parallel 
counter of high speed is to: (1) use resistors to convert 
logic inputs into currents, (2) use GHz op-amp to add 
these currents together and convert the current sum to 
voltage, then (3) use GHz D/A converter to convert the 
voltage to binary number. A 3-bit parallel counter of such 
construct is shown in FIG. 14. In the first stage, the cur- 
rents of 7 bit inputs (D6 D5 D4 D3 D2 Dl DO) driving 7 
resisters of identical resistance R are summed up by the 
first op-amp 131, which has a feedback resistor of 1/4 R. 
When the count of the positively asserted bit input is 
equal to or larger than 4, the voltage at the output of the 
first op-amp 131 is equal or larger than the voltage of 
logic 1, thus the output G2 of the first analog comparator 
132 is positively asserted, which is the most significant bit 
of the counter output; otherwise, C2 is negatively as- 
serted. Through analog switches 133 and 135, when C2 is 
positively asserts, a voltage of logic 1 is subtracted from 
the output of the first op-amp 131 by a second op-amp 
134; otherwise, the output of the first op-amp 131 is 
passed directly to the next stage. The input at the next 
stage is scaled up by 2-fold by the third op-amp 136, to 



find the bit CI of tlie counter output by a second analog 
comparator 137. Same procedure goes on until all bits of 
the counter output are found. In this way, a fast parallel 
counter is constructed with fairly small number of op- 
amps. Such scheme can be extended to 255-inputs and 
8-bit outputs using 16 op-amps, 16 analog switches and 
8 analog comparators. 
[0217] A (2N)-bit parallel counter of slightly slower speed can be 
made of three layers of N-bit parallel counters. An exam- 
ple of constructing a 6-bit parallel counter using 3-bit 
parallel counters is shown in FIG. 15. The first layer 141 is 
consisted of (2an + 1) N-bit parallel counters counting 
(2A(2N) - 1) bit inputs. Out of them, the corresponding 
digit of the counter outputs of (2an - 1) smaller parallel 
counters are counted by N smaller parallel counters in the 
second layer 142. For an example, a second-layer N-bit 
counter i44counts the 1st bit outputs of the first layer N- 
bit counters. Except their most significant bits, the 
counter outputs of the rest two smaller parallel counters 
in the first layer are counted by an additional N-bit paral- 
lel counter 145 in the second layer. The outputs from the 
2nd layer N-bit counters 142 are added together by sev- 
eral smaller parallel counters connected as ripple 1-bit 



adders in the 3rd layer 143, each of them functions lilce a 
multiple inputs and multiple carry outputs 1-bit adder. 
For an example, a third-layer N-bit counter 146 is con- 
nected as a multiple carry-in and multiple carry-out 1-bit 
adder for the 2nd bit output of the (2N)-bit counter. A 
conventional 1-bit adder i47 may be used for the 0th bit 
output of the (2N)-bit counter. Using this technique, a 
16-bit output parallel counter of 6-cycle delay can be 
made of two hundred and sixty-eight 8-bit output parallel 

counters, and one 6-bit output parallel counter. 
Multi-channel Multiplexer and Demultiplexer 

[0218] A multi-channel multiplexer selects a channel width num- 
ber of consecutive bit inputs starting from a bit address. 
When the channel width is non-zero, the bit address not 
only selects the corresponding bit input to the LSB output, 
but also the bit input which has immediately higher bit 
address to the next-to-LSB output, and so forth. A multi- 
channel demultiplexer is the functionally reverse of the 
corresponding multi-channel multiplexer. An example of 
8-input 4-channel multiplexer is shown in FIG. 16. The 
channel inputs are (X7 X6 X5 X4 X3 X2 XI XO). The Chan- 
nel outputs are (Z3 Z2 Zl ZO). The channel width selec- 
tions are (Wl WO). The channel address inputs are (A2 Al 



AO). (A2 Al AO) selects one of (X7 X6 X5 X4 X3 X2 XI XO) 
as ZO in the same manner as a normal multiplexer. When 
either Wl or WO is positively asserted, (A2 Al AO) selects 
one of (X7 X6 X5 X4 X3 X2 XI) as Zl, which has immedi- 
ately higher input bit address than ZO. When Wl is posi- 
tively asserted, (A2 Al AO) selects one of (X7 X6 X5 X4 X3 
X2) as Z2, which has immediately higher input bit address 
than Zl. When both Wl and WO are positively asserted, 
(A2 Al AO) selects one of (X7 X6 X5 X4 X3) as Z3, which 
has immediately higher input bit address than Z2. Thus, 
the number of valid bit outputs is determined by the value 
of the channel width selections (Wl WO). The correspond- 
ing 8-output 4-channel demultiplexer is shown in FIG. 17. 
The channel inputs are (X3 X2 XI XO). The Channel out- 
puts are (Z7 Z6 Z5 Z4 Z3 Z2 Zl ZO). The channel width se- 
lections are (Wl WO). The channel address inputs are (A2 
Al AO). (A2 Al AO) selects one of (Z7 Z6 Z5 Z4 Z3 Z2 Zl 
ZO) from XO in the same manner as a normal demulti- 
plexer. When either Wl or WO is positively asserted, (A2 
Al AO) selects one of (Z7 Z6 Z5 Z4 Z3 Z2 Zl) from XI, 
which has immediately higher input bit address than XO. 
When Wl is positively asserted, (A2 Al AO) selects one of 
(Z7 Z6 Z5 Z4 Z3 Z2) from X2, which has immediately 



higher input bit address than XI. When both Wl and WO 
are positively asserted, (A2 Al AO) selects one of (Z7 Z6 
Z5 Z4 Z3) from X3, which has immediately higher input bit 
address than X2. Thus, the number of valid output chan- 
nels is determined by the value of the channel width se- 
lections (Wl WO). 
Construct of a Database/Math Memory Element 

[0219] The memory elements are the basic units within a CP 

memory that store and process data, each of which com- 
prises preferably at least one addressable registers, pos- 
sibly other registers, a control unit, and some processing 
power. FIG. 18 shows the memory element construct of a 
math memory, which could be either math ID memory or 
math 2D memory, which only differs in number of neigh- 
borhood connections. It can be turned into the memory 
element of a database memory by deleting components 
from it, as described later in this Description. 

[0220] Most conventional massive parallel architectures implore 
bit serial operation to save semiconductor construct on 
each processing element. The CP memory may use some 
new hardware components such as parallel comparator 
and multi-channel multiplexer and multi-channel demul- 
tiplexer, or improved hardware component such as paral- 



lei adder, to implore bit parallel operation to improve the 
performance without paying a high price in semiconductor 
construct for each processing element. 
[0221] jhe registers within memory element can be categorized 
as either addressable register or internal register, de- 
pending on whether it is accessible by the exclusive bus 
105 and thus from outside the CP memory using the reg- 
ister address of the register. All the registers in FIG. 18 
are addressable registers. In this way, while the CP mem- 
ory is concurrently processing one set of registers, the 
other set of registers can be prepared for another task by 
exclusive access means such as direct memory access, 
since the exclusive bus J05and the concurrent bus 109 
within a CP memory can work independently from each 
other. 

[0222] Some registers have special functions. 

[0223] (1) One register of the memory element is a neighboring 
register 201, which is connected concurrently to neighbor- 
ing memory elements through neighborhood connections 
114. Such connections from different two neighboring 
memory elements are ll4a and ll4b respectively for a 
math ID memory or a database memory. A math 2D 
memory has four such connections from different four 



neighboring memory elements in each of its memory ele- 
ments. Except the neighboring memory element count 
and the partition of element address into X address and Y 
address, a math 2D memory is otherwise identical to a 
math ID memory. 

[0224] (2) One register of the memory element is a status regis- 
ter 203. When being activated by the exclusive connection 
111 to the enable bit input of the control unit 210, a mem- 
ory element can have internal states, which is determined 
by inputs to the control unit 210. Some of the bits of a 
status register 203 are connected to the control unit 210 
through connection 209, and can be set or reset by the 
control unit 210. The status register 203 contains a carry 
bit and at least one status bit. 

[0225] (3) One register of the memory element is an operation 

register 200. A bit multiplexer/demultiplexer 213, which is 
a multi-channel multiplexer/demultiplexer, can either se- 
lectively read any bit section of the operation register 200 
when the write control bit 226 is negatively asserted, or 
selectively write any bit section of the operation register 
200 when the write control bit 226 is positively asserted. 

[0226] (4) The rest registers 202 of the memory element are data 
registers. A register multiplexer/demultiplexer 2i2, which 



is also a multi-channel multiplexer/demultiplexer, can: 
either (A) selectively read any bit section of the data regis- 
ters 202 and the neighboring register 201 of the memory 
element, the neighboring registers in the neighboring 
memory elements through the neighborhood connections 
114a, 114b, etc, and the data portion 204 from the concur- 
rent bus i09 when the write control bit 225 is negatively 
asserted, or (B) selectively write any bit section of the data 
registers 202 and the neighboring register 201 of the 
memory element when the write control bit 225 is posi- 
tively asserted. 

[0227] The concurrent bus 109 carries element instruction to the 

memory elements in the format of: 
[0228] "condition: operation width [bit] register[bit]" 

[0229] The bit width of the operant is the "width" code. The value 
starts from 0 for bit-serial operation, and ends at one less 
than the bit width of the operation register 200. It is sent 
to both the register multiplexer/demultiplexer 2i2 and the 
bit multiplexer/demultiplexer 213. as the channel width 
inputs 

[0230] One operant is the first "[bit]" code, which is a portion 206 
of the concurrent bus 109 that is sent to the bit multi- 
plexer/demultiplexer 213 3iS the address input. When the 



write control bit 226 of the bit multiplexer/demultiplexer 
213 is negatively asserted, a bit section of the operation 
register 200 of "width" width starting from bit significance 
"[bit]" and up is cached at the "read" output 221 of the bit 
multiplexer/demultiplexer 213 and is denoted as "[bit]" 

221. 

[0231] jhe other operant is the "register[bit]" code, which is an- 
other portion 205 of the concurrent bus i09 that is sent to 
the register multiplexer/demultiplexer 212 as the address 
input. The "register" could be any one of: its own neigh- 
boring register 201 and data registers 202, its neighbor's 
neighboring registers ll4a, ll4b, etc, and the data portion 
204 on the concurrent bus 109. The "[bit]" specifies the 
lowest bit significance of the bit section of "width" width. 
When the write control bit 225 is negatively asserted, the 
bit section specified by "register[bit]" is cached at the 
"read" output 220 of the register multiplexer/demulti- 
plexer 212 and is denoted as "register[bit]" 220. The data 
registers 202 may form a random access memory of bits 
so that a selection of bit section may across register 
boundary. 

[0232] Jhe "condition: operation" portion 207 of the concurrent 
bus 109 is input into the control unit 210. The "condition" 



code is the condition for finisliing executing tlie "opera- 
tion width [bit] register[bit]" portion of the instruction. It is 
implemented by the inputs into the control unit 210 com- 
prising the connection from the status register 209, the 
AND- or OR- logic combination 222 of all the bits of "reg- 
ister[bit]" 220 or "[bit]" 221, and the outputs of a compara- 
tor 211 which compares the values of the "[bit]" 221 and 
the "register[bit]" 220 

[0233] The "condition" code of the instruction can be: (A) none, 
(B) any one of, (C) the AND or OR combination of any ones 
from any two categories of: 

[0234] (1) "ANY register[bit]", "ALL register[bit]": If any or all the 
"register[bit]" 220 bits are positively asserted respectively. 

[0235] (2) "ANY [bit]", "ALL [bit]": If any or all the "[bit]" 221 bits is 
positively asserted respectively. 

[0236] (3) <^ <=^ =^ >=^ >: If the corresponding value rela- 
tion between the "register[bit]" 220 and the "[bit]" 221 is 
satisfied. 

[0237] (4) s: if the status bit of the status register 203 is being 
negatively or positively asserted respectively. 

[0238] (5) E, C: if the carry bit of the status register 203 is being 
negatively or positively asserted respectively. A database 
memory has no carry bit in the status register 203, thus no 



this category of "condition" code. 

[0239] If the condition is not met, the instruction execution ter- 
minates before executing the "operation" code, as if the 
memory element is not activated. 

[0240] The "operation" code is different for a database memory 
and a math memory. 

[0241] jhe memory elements of a database memory have neither 
carry bit in its status register 203, nor adder 214, nor op- 
eration multiplexer 215, nor op-code outputs 208 of the 
control units 210. The "register[bit]"220 is connected di- 
rectly to the operation result 222. Thus, the set of "opera- 
tion" code contains at least: 

[0242] (1) vvA (Write address): to positively assert the match bit 
output 112. 

[0243] (2) WR (Write): to copy the "register[bit]" 220 to the bit 

section of the operation register 200 specified by "[bit]". 
[0244] (3) RD (Read): to copy the "[bit]" 221 to the bit section of 

any one of its data registers202 or its own neighboring 

register 201 specified by "register[bit]". 
[0245] (4) cs (Clear Status): negatively assert the status bit of the 

status register 203. 
[0246] (5) ss (Set Status): positively assert the status bit of the 

status register 203. 



[0247] jhe memory element of a math memory is more complex. 
An adder 214 inputs the "register[bit]" 220, the "[bit]" 221, 
the carry bit of the status register 203, and outputs the 
sum to an operation multiplexer 2i5 while setting the 
carry bit of the status register 203 accordingly. As by 
product of adding the "register[bit]" 220 and the "[bit]" 
221, the adder 214 also outputs the bitwise AND-, OR- 
and XOR- combination of the "[bit]" 221 and "register[bit]" 
220 to the operation multiplexer 215. The operation multi- 
plexer 2i5 also inputs the "register[bit]" 220, and the bit- 
wise complement of the "[bit]" 221. The control unit 210 
may select an operation result 222 from an operation mul- 
tiplexer 2J5 through an op-code connection 205 and save 
the operation result 222 to the "[bit]" bit of the operation 
register 200 by positively asserting the write control bit 
226 of the bit multiplexer/demultiplexer 213. As a result, 
the set of "operation" code contains at least the addition 
of: 

[0248] (5) NG (Negate): to select the bitwise complement of the 
"[bit]" 22i as the output 222 of the operation multiplexer 
215, and to copy it to the bit section of the operation reg- 
ister 200 specified by "[bit]". This operation logically in- 
verts each bits of the bit section of the operation register 



200 specified by "[bit]". 

[0249] (7) ND (AND): to logically AND combine the corresponding 
bits of the "register[bit]" 220 and the "[bit]" 221, and to 
copy the result to the bit section of the operation register 
200 specified by "[bit]". 

[0250] (8) OR (OR): to logically OR combine the corresponding 
bits of the "register[bit]" 220 and the"[bit]" 221, and to 
copy the result to the bit section of the operation register 
200 specified by "[bit]". 

[0251] (9) XR (XOR): to logically XOR combine the corresponding 
bits of the "register[bit]" 220 and the "[bit]" 221, and to 
copy the result to the bit section of the operation register 
200 specified by "[bit]". 

[0252] (10) AD (Add): to add the values of the "register[bit]" 220 
and the "[bit]" 221 with the carry bit of the status register 
203, to set the carry bit of the status register 203 from 
adding, and to copy the result of adding to the bit section 
of the operation register 200 specified by "[bit]". 

[0253] (11) cc (Clear Carry): to negatively assert the carry bit of 
the status register 203. 

[0254] (12) SC (Set Carry): to positively assert the carry bit of the 
status register 203. 

[0255] The register multiplexer/demultiplexer 212 and the bit 



multiplexer/demultiplexer 2i3 enable instant bit-wise 
sliift operations of any amount. Tlius, each of all the 
memory elements of a math memory can carry out multi- 
plication and division using a series of addition, subtrac- 
tion and shift operations. Other math operations are also 
possible. 

[0256] jhe coding of the element instruction set are designed so 
that multiple "operation" codes can be carried concur- 
rently by the concurrent bus 109 in a same element in- 
struction for the same "register[bit]" code and the "[bit]" 
code provided that these "operation" codes may be carried 
out concurrently without confliction. For an example, the 
concurrent positively assertion of the write control bit 225 
of the register multiplexer/demultiplexer 212 and the 
write control bit 226 of the bit multiplexer/demultiplexer 
213 in the memory elements of a database memory results 
in exchange the two set of bits of the two registers. Thus, 
the "operation" codes for "WR" and "RD" should be con- 
current for each other. 

[0257] All element instruction may have same length and uses 

one clock cycle, so that the memory element circuit can be 
treated as combinational logic. The control unit 210 sends 
pulse signal 231, 232, and 233, to other components of a 



database memory element, or pulse signal 231, 232, 233, 
234, and 235 to other components of a math memory ele- 
ment. The timing logic is the following: 

[0258] (1) The control unit 210 pulses the enable bit input 231 
while negatively asserting the write control bit 225 of the 
bit & register multiplexer/demultiplexer 212, to read "reg- 
ister[bit]" bit section to its "read" output 220. At the same 
time, the control unit 210 pulses the enable bit input 232 
while negatively asserting the write control bit 226 of the 
bit multiplexer/demultiplexer 213 to read "[bit]" bit sec- 
tion to its "read" output 221. 

[0259] (2a) The control unit 210 pulses the enable bit input 233 of 
the comparator 211. 

[0260] (2b) At the same time, the control unit 210 of a math 

memory pulses the enable bit input234 of the adder 214. 

[0261] (3) If tiie "condition" code of the instruction is not met, 
the control unit 210 sends no more timing signals for the 
instruction cycle, and the instruction execution termi- 
nates. Otherwise, the control unit 2i0 of a math memory 
pulses the enable bit input 235 of the operation multi- 
plexer 215. 

[0262] (4) According to the "operation" code, the control unit 210 
may: (A) pulse the enable bit input 231 while positively as- 



serting the write control bit 225 of tlie register multi- 
plexer/demultiplexer 2i2, or (B) pulse the enable bit input 
2J2 while positively asserting the write control bit 226 of 
the bit multiplexer/demultiplexer 213, or (C) positively as- 
sert the match bit output 112, or (D) combination of (A) 
and (B), or (E) combination of (A) and (C), or (F) combina- 
tion of (B) and (C), or (G) combination of (A) and (B) and 
(C) 

Simplification for Discussion 

[0263] The neighboring registers 201 of all the enabled memory 
elements are collectively referred to as the neighboring 
layer. The operation registers 200 of all the enabled mem- 
ory elements are collectively referred to as the operation 
layer. The data registers 202 of all the enabled memory el- 
ements are collectively referred to as the data Iayers202. 
The status bits and the carry bits of the status registers 
203 of all the enabled memory elements are collectively 
referred to as the status layer and the carry layer, respec- 
tively. 

[0264] In a database memory or a math ID memory, the neigh- 
boring layers of the memory element whose address is 
immediately lower or immediately higher than that of the 
memory element which is being operated on is called the 



left layer ll4a and the right layer ll4b, respectively. In a 
math 2D memory, the neighboring layers of the memory 
element whose Y address is the same as while whose X 
address is immediately lower or immediately higher than 
that of the memory element which is being operated on is 
called the left layer and the right layer, respectively; while 
the neighboring layers of the memory element whose X 
address is the same as while whose Y address is immedi- 
ately lower or immediately higher than that of the memory 
element which is being operated on is called the bottom 
layer and the top layer, respectively. 

[0265] If a database memory contains non-addressable registers, 
the content of its non-addressable is accessible through 
its operation register 200 and any one of its addressable 
registers 106. Thus, all registers are treated as address- 
able registers 106. And the operation register 200 should 
be addressable for optimal performance in this case. 

[0266] The following simplifications are applied only for dis- 
cussing the usage of the CP memory. They are by no 
mean the constraints on the construct or application of 
the CP memory. 

[0267] Each memory element has only one status bit in its status 
register 203. Each of its other registers 200, 20i, and 202 



has enough bit width to hold each datum for the array. 
[0268] Each memory element has only one neighboring register 

201. 

[0269] An array of total N items is stored in the data layer(s) 202 

of a database memory or a math memory, and the status 

bits of all memory elements are reset initially. The start 

address and the end address for the general decoder no 

of the memory are defaulted to point to the first and last 

items of the array respectively, and the carry number for 

the general decoder of the memory is defaulted to 1. 
Use of Database Memory 

[0270] A database memory provides instant execution of almost 
all basic operations to manage database tables, each of 
which is an array of records. The following table compares 
the order of required instruction cycle count of all basic 
operations using a conventional random access memory 
(RAM) vs. using a database memory (DBM): 
Speed improvement of using database memory 



OPERATION 


RAM 


DBM 


Delete any item 


~N 


~1 


Insert a new item 


~N 


~1 


Match an item 


~N or log(N) 


~1 


Count matched items 


~N 


~1 



Enumerate M matched items 


~N 


~M 


Histogram of M sections 


~N 


~M 


Find local max/min 


~N 


~1 


Find global max/min 


~N 


~log(N) 


Order all items 


~(N Log(N)) to ~N'^2 


~sqrt(N)to~N 



[0271] In the above table, for match using RAM, a normal match 
requires ~N instruction cycles; if a index table has been 
maintained for the item to be matched, the match is done 
using binary tree search and it requires ~log(N) instruction 
cycles. 

[0272] In the above table, both the average and the worse-case 

instruction cycles for ordering all items are given. 
Use of Math Memory 

[0273] A math ID memory can be used instead of a database 

memory to hold arrays and database tables, providing ad- 
ditional benefit of: (A) counting degree of matching; (B) 
Find local minimum and maximum using a difference 
threshold; and (C) provide more efficient sorting algo- 
rithm. 

[0274] The parallel problems can be solved much more efficiently 
using a math memory (MIM or M2M) than using a con- 
ventional random access memory (RAM). The required in- 
struction cycle counts for most common parallel problems 



are shown in the following: 

Speed improvement of using ID math memory 



OPERATION 


RAM 


M1M 


Filter of size M 


~(N M) 


~M 


Sum 


~N 


~sqrt(N) 


Match template of size M 


~(N M) 




Speed improvement of using 2D math memory 


OPERATION 


RAM 


M2M 


Filter of size (Mx by My) 


~(Nx Ny Mx My) 


~(Mx My) 


Sum 


~(Nx Ny) 


~cbrt(Nx Ny) 


Match template of size (Mx by 
My) 


~(Nx Ny Mx My) 


~(Mx'^2 My) 


Recognize Line (to 1/D angle) 


~(Nx Ny 0^2) 


-0^2 



Content Moving 

[0275] An algorithm for deleting the item at a deletion element 
address is: 

[0276] (1) Set the start address to one above the deletion element 
address. 

[0277] (2) Copy a data Iayer202 to the operation layer 200. 

[0278] (3) Copy the operation layer 200 to the neighboring layer 

201. 

[0279] (4) Set the start address to the deletion element address. 



[0280] (5) Set the end address to one below the last used mem- 
ory element 108 of all the database memory. 
[0281] (5) Copy the operation layer 200 from the right layer ll4b. 

[0282] (7) Copy the operation layer to the same data layer 202. 

[0283] (8) Repeat step (1) to (7) for all other data layers 202. 

[0284] An algorithm for inserting a new item to an insertion ele- 
ment address is: 
[0285] (1) Set the start address to the insertion element address. 

[0286] (2) Copy a data layer 202 to the operation layer 200. 

[0287] (3) Copy the operation layer 200 to the neighboring layer 

201. 

[0288] (4) Set the start address to one above the insertion ele- 
ment address. 

[0289] (5) Set the end address to one above the last used mem- 
ory element 108 of all the database memory. 
[0290] (6) Copy the operation layer 200 from the left layer ll4a. 

[0291] (7) Copy the operation layer to the same data layer 202. 

[0292] (8) Repeat step (1) to (7) for all other data layers 200, to 
move all the items above the insertion address up by one 
element. 

[0293] (9) Copy a datum of the new item from the data bus of the 



external data bus 102 to the corresponding data register 
202 of the memory element 108 at the insertion element 
address using the exclusive bus 105. 

[0294] (10) Repeat step (9) until all the data of the new item are 
copied from the external data bus i02 to the correspond- 
ing data registers 202 of the memory element 108 at the 
insertion element address. 

[0295] Because of its instant content moving ability, a database 
memory has all the benefit of a content movable memory. 
The tables stored in the database memory are truly dy- 
namic, without needs for look-ahead allocation and link 
list, and at the same time the database memory is closely 
packed, without being fragmented after extensive inser- 
tions and deletions. Instead of the element address of the 
memory element that stores the record, each record can 
be referred by its primary key ID, and the actual storage of 
the data may be managed internally by the database 
memory. 

[0296] A math memory has all the benefit of a database memory. 

Using similar algorithm, a 2D math memory can insert or 

delete its data based on columns and rows. 
Content Matching 

[0297] An algorithm for matching items is: 



[0298] (1) Copy the data layer 202 to be matched to the operation 
Iayer200. 

[0299] (2) Assert positively the status layer. 

[0300] (3) Match the operation Iayer200with the data portion 204 
of the concurrent bus 109, according to the "condition" of 
the concurrent bus 109, which is the logical opposite of 
the match requirement, and negatively assert the status 
layer if the "condition" is met. 

[0301] (4) If there are further matching conditions, repeat step 
(3). 

[0302] (5) The matched items have positively asserted status bits, 
and further operation may be carried out concurrently on 
the matched items without knowing their actual positions. 

[0303] It Is easy to design an alternative algorithm similar to the 
above algorithm based on the match requirement rather 
than its logical opposite, or combination of the two. 

[0304] An algorithm for counting matched items is: 

[0305] (1) Assert positively the match bit outputs 112 of all the 
matched memory elements i08 concurrently. 

[0306] (2) The count output of the parallel counter 113 contains 
the count of the matched memory elements. 

[0307] An algorithm for enumerating matched items is: 



[0308] (1) Set the priority of tlie priority encoder 113 to be from 
higli to low. 

[0309] (2) Assert positively the match bit outputs 112 of all the 
matched memory elementsiOS concurrently. 

[0310] (3) If the no-hit bit output of the priority encoder 113 is 
positively asserted, all the matched memory elements 108 
have been enumerated, and the enumerating algorithm is 
terminated. Otherwise, the the address output of the pri- 
ority encoder ii3contains the highest element address of 
the matched memory elements 108 between the start ad- 
dress and the end address. 

[0311] (4) Set the end address to one less than the element ad- 
dress which has been found in step (3). 

[0312] (5) Repeat step (3) to step (4). 

[0313] It is easy to design an alternative algorithm similar to the 
above algorithm based on the low-to-high priority of the 
priority encoder 113. Due to the design of the general de- 
coder 110, changing its start address input may be less 
efficient than changing its end address input. 

[0314] Because any matching operation in an array of N items 

stored in a conventional random access memory requires 
~N instruction cycles, traditional databases relies on index 
tables, each of the index tables stores the sorting order of 



a field in tlie original table. During a match on the field, 
the index tables are matched using a binary-tree search, 
requiring ~log(N) instruction cycles, instead of the ~N in- 
struction cycles required when the original table is 
matched. When a new record is added, or an existing 
record is modified, the index tables are modified accord- 
ingly. The extensively use of index tables requires a lot of 
additional memory and processing powers. Especially, all 
index tables have to be updated properly and promptly, 
otherwise if any index table contains wrong information, 
the search results become unreliable, and the database it- 
self may become unstable. Managing index tables is a 
major tasking in any traditional databases. 

[0315] When using database memories to store the array, match- 
ing items or counting matched items only takes ~1 in- 
struction cycles. This means not only that the required in- 
struction cycles are greatly reduced, but also that the in- 
dex tables are no longer required, so that the database 
can be much more efficient and stable. 

[0316] The processing power of math memory adds new func- 
tionality to the database management. An algorithm for 
matching items and calculating degrees of matching using 
a math ID memory is: 



[0317] (1) Send a zero to all the memory elements using the con- 
current bus 109 and copy it to the operation layer 200. 

[0318] (2) Match all the memory elements 108 against one re- 
quirement. 

[0319] (3) Send a weight number to all the memory elements us- 
ing the concurrent bus and add it to the operation layer 
200 of all the matched memory elements 108 in step (2). 

[0320] (4) If there are further matching requirements, repeat step 
(2) to (3) for all the memory elements 108. 

[0321] (5) The operation layer 200 contains the degree of match- 
ing of the requirements. 

[0322] Similar algorithm can be constructed using a data base 
memory which can increment its operation Iayer200. 

[0323] The ability to calculate the degree of matching not only 
allows exactly match as currently provided by conven- 
tional database engine, but also allows quantified fussy 
match as currently provided by web search engine. The 
items of the array may be further handled according to 

their degree of matching. 
Content Statistics 

[0324] An algorithm to construct a histogram of M sections is: 
[0325] (1) Copy the data layer 202 to be matched to the operation 



layer 200. 

[0326] (2) Assert positively the match bit outputs 112 of all the 
memory elements whose status layer is negatively as- 
serted and whose operation layer 200 is larger than the 
data portion 204 of the concurrent bus 109, which contains 
the first section limit from large to small. 

[0327] (3) jhe count output of the parallel counter 113 contains 
the histogram count of the first section. 

[0328] (4) Assert positively the status layer of all the memory ele- 
ments whose operation layer 200 is larger than the data 
portion 204 of the concurrent bus 109. Step (4) masks off 
those memory elements i08 which have already been 
counted. 

[0329] (5) Repeat step (2) to (4) for all the rest section limits from 
large to small of the M histogram sections. 

[0330] The histogram of the data can be used to estimate the 
sum and the distribution of the data. 

[0331] An algorithm to find the local maximums is: 

[0332] (1) Copy the data layer 202 to be characterized to the op- 
eration layer 200. 
[0333] (2) Copy the operation layer 200 to the neighboring layer 

201. 

[0334] (3) Assert positively the status layer of all the memory ele- 



merits each of whose operation layer 200 is larger than the 
neighboring layer 114 of their neighboring memory ele- 
ments. This procedure can be carried out in two steps: (A) 
positively assert the status layer if the operation layer 200 
is larger than the neighboring layer ll4a of one of their 
neighboring memory elements; and (B) negatively assert 
the status layer if the status layer itself is positively as- 
serted and the operation layer 200 is smaller than the 
neighboring layer ll4b of any other of their neighboring 
memory elements. 
[0335] An algorithm to find the local minimums can be similarly 
constructed. 

[0336] An algorithm to find the local maximums with a difference 
threshold using a math memory is: 

[0337] (1) Copy the data layer 202 to be characterized to the op- 
eration layer 200. 

[0338] (2) Copy the operation layer 200 to the neighboring layer 
201. 

[0339] (3) Send the difference threshold to all the memory ele- 
ments i08 through concurrent bus i09 and add it to the 
operation Iayer200. 

[0340] (4) Assert positively the status layer of all the memory ele- 
ments each of whose operation layer 200 is larger than the 



neighboring layer 114 of tlieir neigliboring memory ele- 
ments. 

[0341] The algorithm to find the local minimums using difference 

threshold is similar. 
[0342] The use of difference threshold reduces the effect of noise 

presented in the original data when determining the local 

minimums and maximums. 
[0343] An open-end binary tree algorithm to find a global upper 

limit to the data is: 
[0344] (1) Designate a variable denoted as FOLD, and initiate it 

with 1. 

[0345] (2) Designate a variable denoted as ADDR. 
[0346] (3) Designate a variable denoted as MAX. 
[0347] (4) Designate a variable denoted as VAL. 

[0348] (5) Find the local maximums. As a result, the memory ele- 
ments i08 which are local maximums have status layer 
positively asserted and operation layer 200 containing data 
to be characterized. 

[0349] (5) Set the priority of the priority encoder 113 to be from 
high to low. 

[0350] (7) Assert positively the match bit outputs 112 of all the 
memory elements i08 whose status layer has been posi- 



lively asserted. 

[0351] (3) Read the output address of the priority encoder 113 
into ADDR. 

[0352] (9) Read the operation register 200 in the memory element 

108 at element address ADDR into MAX. 
[0353] (10) Let VAL = MAX. 

[0354] (11) Set the end address to be one less than ADDR. 

[0355] (12) Assert positively the match bit outputs 112 of all the 
memory elements 108 whose status layer has been posi- 
tively asserted and whose operation layer 200 is larger 
than VAL 

[0356] (13) Read the output address of the priority encoder 113. 
If it contains NULL, a global upper limit is in VAL while the 
largest known value is MAX at the element address ADDR, 
and the algorithm terminates. Otherwise, save it into 
ADDR. 

[0357] (14) Read the operation register 200 in the memory ele- 
ment 108 at the element address ADDR into MAX. 
[0358] (15) Let VAL = VAL + (MAX - VAL) * FOLD. 

[0359] (16) Double the value of FOLD. 

[0360] (17) Repeat step (11) to (16). 



[0361] jhe algorithm can be continued in close-end binary tree 
manner to find the global maximum of the data, as the 
following: 

[0362] (20) Let VAL = (VAL + MAX) / 2. 

[0363] (21) Set the end address to be one less than ADDR. 

[0364] (22) Assert positively the match bit outputs 112 of all the 
memory elements i08 whose status layer has been posi- 
tively asserted and whose operation layer 200 is larger 
than VAL 

[0365] (23) Read the output address of the priority encoder 113. 
If it contains NULL, VAL contains a better global upper 
limit, and step (20) to (23) is repeated. Otherwise, save it 
into ADDR. 

[0366] (24) Read the operation register 200 in the memory ele- 
ment 108 at the element address ADDR into MAX. 

[0367] (24) Assert positively the match bit outputs 112 of all the 
memory elements whose status layer has been positively 
asserted and whose operation layer 200 is larger than 
MAX. 

[0368] (25) Read the output address of the priority encoder 113. 
If it contains NULL, the global maximum is MAX at address 
ADDR, and the algorithm terminates. Otherwise, save it 



into ADDR and repeat step (24) to (26). 

[0369] To find a upper global limit and the global maximum for a 
randomly arranged set of {1, 2, 3, ... N}, the above algo- 
rithms take ~log(N) instruction cycles on average. 

[0370] An algorithm to find a lower global limit and the global 
minimum can be similarly constructed. 

[0371] jhe ability to quickly find and count the local extreme 

values, and the ability to quickly find the global limits, the 

global extreme values, the histogram, the estimated sum 

of a large set of data means that a database memory or a 

math memory can be used in statistical processing such 

as estimating its distribution. 
Sorting 

[0372] Because of its instant match finding ability, a database 
memory require no index table and much less sorting of 
data. Still, it is possible to sort data using a database 
memory with much less instruction cycles than what is re- 
quired using a conventional random access memory. 

[0373] An algorithm to see if the array is in order is the follow- 
ing: 

[0374] (1) Copy the data layer 202 which contains the data to be 

characterized to the operation layer 200. 
[0375] (2) Copy the operation layer 200 to the neighboring layer 



201. 

[0376] (3) Set the start address to one more than the first item. 

[0377] (4) Assert positively the match bit outputs 112 of all the 

memory elements i08 whose operation layer 200 is smaller 

than left layer ll4a. 
[0378] (5) Read the count output of the parallel adder 113. If it 

equals zero or the total item count, the array is already 

sorted. 

[0379] jhe above count output is the disorder count to sort the 
array into small-to-large order. The disorder count to sort 
the array into large-to-small order can be found similarly. 
To sort an array in either way is functionally equivalent- 
-the other sorting order can be achieved by reading from 
end item to start item of one sorting order. Thus, the two 
disorder count is compared to select a better sorting or- 
der of the two, and the worst case for sorting — to sort an 
almost sorted array into another order — can be avoided. 

[0380] There are two ways to disorder an already ordered array: 
(A) to randomly exchange the adjacent neighboring items, 
to create local disorder; or (B) to remove and insert an 
item randomly to another location, to create global disor- 
der. These two kinds of disorders are dealt with by local 
exchange sorting algorithm and global moving sorting al- 



gorithm respectively. 

[0381] A local exchange sorting algorithm concurrently ex- 
changes all the adjacent two items into correct order. An 
algorithm to exchange once the adjacent even and odd 
numbered items toward small-to-large order is: 

[0382] (1) Carry out the algorithm to find out the disorder count. 
If it is zero, the sorting algorithm terminates. As a result, 
both the operation layer 200 and the neighboring layer 201 
contain data to be characterized. 

[0383] ((2) Set the carry number to 2. 

[0384] (3) Set the start address to one more than the first item. 

[0385] (4) Copy the operation layer 200 from the left layer ll4a if 

the latter is larger. 
[0386] (5) Exchange the operation layer 200 and the data layer 

202 to be characterized if they are different. 
[0387] (5) Set the start address to the first item. 

[0388] (7) Set the end address to one less than the last item if the 

total item count is odd. 
[0389] (8) Copy the operation layer 200 from the right layer ll4b 

if the latter is smaller. 
[0390] (9) Exchange the operation layer 200 and the data layer 

202 to be characterized if they are different. If each item 



contains only one data layer 202, the algorithm termi- 
nates. 

[0391] (10) Assert positively the status layer when the operation 
layer 200 and the data layer 202 to be characterized are 
different. 

[0392] (11) Copy one of the other data layers 202, which is the 
data layer to be transferred, to the operation layer 200. 

[0393] (12) Copy the operation layer 200 to the neighboring layer 
20i. 

[0394] (13) Set the start address to one more than the first item. 

[0395] (14) Set the end address to the last item if the total item 
count is odd. 

[0396] (15) Copy the operation layer 200 from the left layer ll4a 

if the status layer is positively asserted. 
[0397] (15) Exchange the operation layer 200 and the data layer 

202 to be transferred. 
[0398] (17) Copy the operation layer 200 to the neighboring layer 

20J. 

[0399] (18) Set the start address to the first item. 

[0400] (19) Set the end address to one less than the last item if 

the total item count is odd. 
[0401] (20) Copy the operation layer 200 from the right layer ll4b 



if the status layer is positively asserted. 
[0402] (2 1) Copy the operation layer 200 to the data layer 202 to 
be transferred. 

[0403] (22) Step (11) to (21) exchanges the data layer 202 to be 
transferred of the adjacent even and odd numbered items 
which need to be exchanged. Repeat step (11) to (21) to 
transfer each of all the other data layers. 

[0404] An example of such sorting of a one-layer array is the fol- 
lowing: 
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[0405] An algorithm to exchange the adjacent odd and even 
numbered items once into small-to-large order can be 
similarly constructed. The local exchange sorting algo- 
rithm comprises of repeated alternative execution of al- 
gorithm to exchange once the adjacent items of (A) even 
and odd numbered, and (B) odd and even numbered. Us- 



ing this sorting algoritlim alone can sort an array in no 
more than ~N instruction cycles. 

[0406] The local exchange sorting algorithm may not be efficient 
enough because the array may be nearly sorted except a 
very few difficult items which still walk one element at a 
time toward their final destinations. Using a math ID 
memory, or a database memory which can increment or 
decrement its operation layer, an improved algorithm 
awards walks in correct direction with jumps: 

[0407] (1) A minimal and a maximal cap of the array are inserted 
as the first and last items, respectively. 

[0408] (2) Each item carries a walk number, which is initiated to 
0. 

[0409] (3) Designate a threshold M for the walk number. 

[0410] (4) Check if the array is already sorted. If yes, terminate 
the algorithm by removing the first and last items. 

[0411] (5) Carry out one local exchange sorting toward small- 
to-large order. If an item walks to right, its walk number 
is increased by 1; otherwise, if it walks to left, its walk 
number is decreased by 1. 

[0412] (5) By content matching means, with the priority from 

right to left, enumerate an item whose walk number reach 
+ M. 



[0413] (7) The value of each such item is compared with all the 
other items to its right using content matching means, 
with the priority from left to right, and the leftmost item 
whose value is not smaller than such item is found. 

[0414] (3) If the newly found item has not a negative walking 

number, such item is moved to the left of the newly found 
item. The walk number of such item is reset to 0. 

[0415] (9) By content matching means, with the priority from left 
to right, enumerate an item whose walk number reach -M. 

[0416] (10) The value of each such item is compared with all the 
other items to its left using content matching means, with 
the priority from right to left, and the rightmost item 
whose value is not larger than such item is found. 

[0417] (11) If the newly found item has not a positive walking 
number, such item is moved to the right of the newly 
found item. The walk number of such item is reset to 0. 

[0418] (12) Repeat step (6) to (11) until there is no item whose 
walk number reaches either +M or -M. 

[0419] (13) Repeat step (4) to (12). 

[0420] To order a randomly arranged set of {1, 2, 3 ... N}, when M 
equals to sqrt(N), the above algorithm takes ~sqrt(N) in- 
struction cycles on average. 

[0421] A global moving sorting algorithm removes disordered 



items in a nearly sorted array and inserts them to proper 
place. It does this by analyzing "topography" of the sort- 
ing disorders. Peak and valley are used to describe sorting 
disorder. A peak 331 is an item whose data layer to be 
characterized contains value larger than those of its both 
neighbors', while a valley 341 is an item whose data layer 
to be characterized contains value smaller than those of 
its both neighbors'. For the small-to-large sorting order, 
a true valley or a true peak has right neighbor not smaller 
than left neighbor. Otherwise they are false valley or false 
peak respectively. General cases of sorting disorder are 
shown in FIG. 19, which shows: 
[0422] (1) Single true valley: Case 321 is identified by a true valley 
342with an adjacent false peak 332 to the left. When the 
true valley 342 is removed, the false peak 332 disappears 
also. 

[0423] (2) Single true peak: Case 322 is identified by a true peak 
333 with an adjacent false valley 343 to the right. When the 
true peak 333 is removed, the false valley 343 disappears 
also. 

[0424] (3) A section of data which is ordered in incorrect order: 
Case 323 is identified by a lone true peak 334 to its left, 
and a lone false valley 344 to its right. Case 324 is identi- 



fied by a lone false peak 335 to its left, and a lone true 
valley 345 to its right. Case 323 and 324 can be merged to- 
gether, with a lone true peak 334 to its left, and a lone 
true valley 345 to its right. Remove one true peak or valley 
from the end of any sections generates another true peak 
or valley, until the whole section is removed. Any of these 
sections may contain lone pairs of apparently false valley 
with an adjacent apparently true peak to the right, or lone 
pairs of apparently true valley with an adjacent apparently 
false peak to the right. Because the topography is re- 
versed from that of single true valley or peak, the appar- 
ently false valley or peak is actually true, while the appar- 
ently true valley or peak is actually false. 

[0425] (4) A section of data which is ordered in correct order but 
in incorrect increment: Both Case 325 and 326 are identi- 
fied by an adjacent pair of false peak and false valley, as 
336 and 346, and 337 and 347. Case 325 and 326 can merge 
together. Applying a local exchange sorting algorithm 
separates out either a true peak or a true valley or both, 
from the ends of the sections. Any of these sections may 
contain a single true valley or peak within the section. 

[0426] The leftmost true valley item can be moved to the right of 
the first item to its left which is smaller than it, or to the 



left end of the array, in ~1 instruction cycles. The right- 
most true peak item can be moved to the left of the first 
item to its right which is larger than it, or to the right end 
of the array, in ~1 instruction cycles. Applying these two 
procedures is the global moving sorting algorithm, which 
may also be used between the applications of local ex- 
change sorting algorithm to accelerate the sorting. 
Local Operations 

[0427] The connectivity and arithmetic ability of a math memory 
enables local operations, such as filtering. A local opera- 
tion involving M neighbors takes ~M instruction cycles 
generally, independent of the total array item count N. 

[0428] For simplicity of following discussion, the neighboring 
layer 201 contains the data to be characterized, or the 
content of the memory element. A special ID vector of 
odd-number of items is used to describe the content 
composition of the operation layer 200 of all the enabled 
memory elements after a concurrent ID local operation in 
a ID math memory. The center item describes the content 
originated from the element itself and is indexed as 0. 
The item left to the center item describes the content 
originated from the left neighbor of the element and is in- 
dexed as -1. The item right to the center item describes 



the content originated from tlie left neiglibor of tlie ele- 
ment and is indexed as +1. So forth. For an example, (1) 
denotes the content of all the enabled memory elements; 
(1 0 0) denotes the content of left neighbors to all the en- 
abled memory elements; (1 1 0) denotes adding the con- 
tent of left neighbors to the content of all the enabled 
memory elements; and (1 1 1) denotes three point aver- 
age for all the enabled memory elements. 

[0429] Tvvo successive operations can be additive if both of them 
use the operation layer accumulatively, such as: 

[0430] (110) = (1) + (10 0); 

[0431] Mathematically, a + operation is defined as: 

[0432] c = A + B: C[i] = A[i] + B[i]; 

[0433] The + operation satisfies: 

[0434] A + B = B + A; 

[0435] (A + B) + C = A + (B + C); 

[0436] When the operation layer 200 is copied to or exchanged 
with the neighboring layer 201, the successive operations 
are no longer addictive. For example, a 3-point (1 2 1) 
Gaussian averaging algorithm is: 

[0437] (1) Copy the data layer 202 to be averaged to the opera- 



tion layer 200. 

[0438] (2) Copy the operation layer 200 to the neighboring layer 

201. 

[0439] (3) Set the start address to be one more than the first 
item. 

[0440] (4) Set the end address to be one less than the last item. 

[0441] (5) Add the left layer ll4a to the operation layer 200. 

[0442] (5) Copy the operation layer 200 to the neighboring layer 
201. 

[0443] (7) Add the right layer ll4b to the operation Iayer200. The 

result is in the operation layer. 
[0444] In the above algorithm, the additive result of step (2) and 

(5) is subjected to Step (7) due to Step (6). Without step 

(6) , step (7) is also additive to step (2) and (5), and the al- 
gorithm result is (1 1 1). When the result of a first opera- 
tion A undergoes a second operation B, the overall opera- 
tion C is expressed mathematically as: 

[0445] c = A # B: C[i] = I (A[i+j] B[i-j]); 

[0446] The # operation satisfies: 

[0447] A # B = B # A; 

[0448] (A # B) # C = A # (B # C); 



[0449] jhe # and + operations satisfy: 
[0450] (A+ B)#C = (A#B) + (A#C); 

[0451] The 3-point (1 2 1) Gaussian averaging algoritlim is ex- 
pressed as: 
[0452] (1 2 1) = (1 1 0) # (0 1 1); 

[0453] A 5-point Gaussian averaging is: 

[0454] (1 2 4 2 1) = (1 1 1) # (1 1 1) + (1); 

[0455] The corresponding algoritlim can be read from tlie matli- 
ematical expression, as: 

[0456] (1) Copy tlie data layer 202 to be averaged to the opera- 
tion layer 200. 

[0457] (2) Copy the operation layer 200 to the neighboring layer 

201. 

[0458] (3) Set the start address to be one more than the first 
item. 

[0459] (4) Set the end address to be one less than the last item. 
[0460] (5) Add the left layer 114a to the operation layer 200. 

[0461] (6) Add the right layer ll4b to the operation layer 200. 

Step (4) to (6) carry out the first (1 1 1) operation. 
[0462] (7) Exchange the operation 200 and the neighboring layers 

201. Step (7) carries out the # operation. 



[0463] (8) Add the left layer ll4a to the operation layer 200. 

[0464] (9) Add the right layer ll4b to the operation layer 200. 

Step (7) to (9) carry out the second (1 1 1) operation. 
[0465] (9) Add the neighboring Iayer20i to the operation layer 

200. Step (9) carries out the "+ (1)" operation. 
[0466] This concept is extendable to 2D local operations, such as 

a 9-point Gaussian averaging: 



/ 1 


2 


1 \ 






1 0 \ 




I 1 \ 


2 


4 


2 


= (1 


1 0) # (0 1 1) # 


1 


n 


1 


■ 1 


2 


1 I 






\ 1 1 




\ 0 / 



[0467] jhe corresponding algorithm can be read from the math- 
ematical expression, as: 

[0468] (1) Copy the data layer 202 to be averaged to the opera- 
tion layer 200. 

[0469] (2) Copy the operation layer 200 to the neighboring layer 
201. 

[0470] (3) Set the start X address to be one more than the left 
boundary. 

[0471] (4) Set the end X address to be one less than the right 
boundary. 

[0472] (5) Set the start Y address to be one more than the bottom 
boundary. 

[0473] (5) Set the end Y address to be one less than the top 
boundary. 



[0474] (7) Add the left layer to the operation layer 200. 

[0475] (3) Copy the operation layer 200 to the neighboring layer 
201. 

[0476] (9) Add the right layer to the operation layer 200. 

[0477] (10) Copy the operation layer 200 to the neighboring layer 

201. 

[0478] (11) Add the bottom layer to the operation layer 200. 

[0479] (12) Copy the operation layer 200 to the neighboring layer 

201. 

[0480] (13) Add the top layer to the operation Iayer200. 
[0481] Or a 9-point 0-degree Sober filtering: 
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[0482] The corresponding algorithm can be read from the math- 
ematical expression, as: 

[0483] (1) Copy the data layer 202 to be characterized to the op- 
eration layer 200. 

[0484] (2) Copy the operation layer 200 to the neighboring layer 
201. 

[0485] (3) Set the start X address to be one more than the left 
boundary. 



[0486] (4) Set the end X address to be one less than the right 
boundary. 

[0487] (5) Set the start Y address to be one more than the bottom 
boundary. 

[0488] (5) Set the end Y address to be one less than the top 
boundary. 

[0489] (7) Copy the left layer to the operation layer 200. 

[0490] (8) Negate the operation layer 200. 

[0491] (9) Add the right layer to the operation layer 200. 

[0492] (10) Copy the operation layer 200 to the neighboring layer 
201. 

[0493] (11) Add the bottom layer to the operation layer 200. 

[0494] (12) Copy the operation layer 200 to the neighboring layer 
201. 

[0495] (13) Add the top layer to the operation layer 200. 
Sum 

[0496] To sum a one-dimensional array of N items, the array is 
divided into sections, each of which contains M consecu- 
tive items. All sections are summed concurrently from left 
to right, in ~ M instruction cycles. Then the section sums, 
which are at the right-most items of every sections, are 



summed together serially in ~ N / M instruction cycles. 
Thus, the total instruction cycle count is ~(M + N / M). 
When M ~ sqrt(N), the total instruction cycle count has a 
minimum of ~ sqrt(N). A detailed sum algorithm is: 
[0497] (1) Copy the data layer 202 to be summed to the operation 
layer 200. 

[0498] (2) Copy the operation layer 200 to the neighboring layer 
201. 

[0499] (3) Set the carry number to M ~ sqrt(N). The M is the item 
count in each section, except the last section which may 
have items less than M. 

[0500] (4) Increment the start address by one. 

[0501] (5) Add the left layer ll4a to the operation layer 200. 

[0502] (5) Exchange the operation layer 200 and the neighboring 
layer 201. 

[0503] (7) Repeat step (4) to (6) M times. The section sums are at 
the neighboring layer 201 of the last items of all sections. 

[0504] (8) Read and add all the neighboring registers 201 of all 

last items of all sections serially, to get the sum of the ar- 
ray. 

[0505] For an example, an array starts with (0, 1, 2, 3, 4, 5, 6, 7) 
is summed as: 



Example of ID array summing 
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0, 1,2, 3, 7, 5, 6, 13 


0,1,2, 3, 4, 5, 6,7 
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0, 1,2, 3, 4, 5, 6,7 


0, 1, 2, 3, 7, 5, 6, 13 


5b 


0, 1,3, 3, 4, 12, 6,7 


0, 1,2,3, 7, 5, 6, 13 
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0,1,2, 3, 4, 5, 6,7 


0, 1,3, 3, 4, 12, 6, 13 
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+ 12 = 15 




8c 


+ 13 = 28 





[0506] The above algorithm can be displayed by an algorithm 
flow diagram in FIG. 20, in which serial operations are 
represented by a series of simple arrows 351, and concur- 
rent parallel operations are represented by a series of ar- 
row with two parallel bars on each side 352. Each arrow 
shows the data range of the operation, such as on a sec- 
tion 356 with M items of the whole array 357 with N items. 
Each series of arrows is marked by a step sequence num- 
ber followed by ":" 353, an instruction cycle count pre- 
ceded by "~" 354, and an operation 355. The instruction 
cycle counts from consecutive and independent steps are 



additive, so the total instruction cycle count is + N / 
>= ~ sqrt(N), which has a minimum of ~sqrt(N) when M ~ 
sqrt(N). 

[0507] Jo sum a two-dimensional array of Nx by Ny items, the 
array is divided into sections, each of which contains Mx 
by My consecutive items. All rows of all sections are 
summed concurrently from left to right, in ~ Mx instruc- 
tion cycles. Then all the right-most columns of all sec- 
tions, each item of which contains a row sums for a sec- 
tion, are summed concurrently from bottom to top. Then 
the top-right-most items of all sections, each of which 
contains a section sum, are scanned and summed to- 
gether serially, with the column and the row direction be- 
ing the fast and the slow scan direction respectively. FIG. 
21 is the corresponding algorithm flow diagram, in which 
step sequence number "4 * 3" 358 means a complete step 
3 is carried out before each instruction cycle of step 4. 
Thus, the total instruction cycle count for such combina- 
tion of steps is the product of the individual instruction 
cycle count of each step. The total instruction cycle count 
is (Mx + My + Nx / Mx Ny / My), which has minimum of 

cbrt(Nx Ny) when Mx ~ My ~ cbrt(Nx Ny). 
Template Matching 



[0508] Jo match a template of size M, the array is divided into N 
/ M sections, each of which contains M consecutive items. 
The algorithm diagram is shown in FIG. 22. In Step 1, the 
template to be matched is loaded to all sections concur- 
rently in ~M instruction cycles. Then the point-to-point 
absolute difference is calculated concurrently for all points 
in ~ 1 instruction cycles, which is omitted from the algo- 
rithm flow diagram. In Step 2, all sections are summed 
concurrently from right to left in ~ M instruction cycles, to 
obtain the difference values of the array to the pattern at 
the first positions to the left of all sections. In the first in- 
struction cycle of Step 3*2, the templates in all sections 
are shifted right by one item, to calculate the difference at 
the second positions of all sections, and so forth. Thus 
the total instruction cycle count is (M + M M) ~ MA2. When 
M > sqrt(N), the summing of all sections is further divided 
into the concurrent summing of subsections, each of 
which contains L consecutive items, and the serial sum- 
ming of the subsections, thus the total instruction cycle 
count is ~(M + (L + N / L) M), or ~ (M sqrt(N)) when L ~ 
sqrt(N). 

[0509] Similar algorithm can be carried out in a 2-D array of size 
Nx by Ny stored in a math 2D memory for a 2-D template 



of size Mx by My. The algorithm diagram is shown in FIG. 
23, which also omits the step of calculating point- 
to-point absolute difference. In step 2 *1, the template to 
be matched is loaded to all sections concurrently in ~MA2 
instruction cycles. The first application of Step 3 sums the 
point-to-point absolute differences of each of all section 
at the first column from left of the section. The first in- 
struction cycle of Step 4 moves the template right by one 
column. The second application of Step 3 sums the point- 
to-point absolute differences of each of all sections at the 
second column from left of the section. The first complete 
application of Step 4*3 fills the sums of row difference of 
the corresponding section. The first application of Step 5 
results in the matching of the template at the first row 
from bottom of each of all sections. The first instruction 
cycle of Step 6 * (4 * 3 + 5) moves the template up by one 
row. The Step 4 * 3 is carried out again except that the 
Step 4 is carried out from right to left this time, since the 
first application of the Step 4 *3 has moved the template 
to the right-most position of each section. Thus, the total 
instruction cycle count is ~(Mx My + (MxA2 + My) My), 
which is equivalent to ~(MxA2 My). 
[0510] Using CP memory, the instruction cycle count for 1-D 



template matching is reduced from ~ (N M) to ~I\/|A2, and 

it is reduced from ~(Nx Ny Mx My) to ~(I\/IxA2 IVIy). It may 

be small enough now for the template matching algorithm 

to be carried out in real-time for a lot of applications, 

such as image database. 
Thresholding 

[0511] With its multiple dimensions of data, image processing 
and spatial modeling generally requires large amount of 
calculation, which is linearly proportional to the size of 
data in each dimension. 

[0512] Using a conventional bus-sharing computer, the instruc- 
tion cycle count is linearly proportional to the amount of 
calculation. Thus, to solve a problem in a realistic time 
period, thresholding is frequently used to ignore large 
amount data in the subsequent processing. Thresholding 
is a major problem, because proper thresholding is diffi- 
cult to achieve, and thresholding in different stages may 
interact with each other. 

[0513] Using a math memory, the instruction cycle count is de- 
coupled from the amount of calculation, and is indepen- 
dent of the size of data in each dimension. Thus, thresh- 
olding can be used only in last stage to qualify the result. 
Also, thresholding itself has been reduced to ~1 instruc- 



tion cycle operation. 
[0514] por an example, to recognize features of an image, one of 

the common conventional methods is to: 
[0515] (1) Use Sobel filters to find edge intensity of the image. 

[0516] (2) Use thresholding to ignore most pixels except those 

which have large edge intensities. In most practice the im- 
age is further reduced into a binary bitmap. 

[0517] (3) Analyze the reduced data set for features, such as 
carry out line recognition. 

[0518] In step (2), if the threshold is too high, true edge pixels 
may be ignored. On the other hand, if it is too low, none 
edge pixels may be included. Both cases add difficulty to 
step (3) and subsequent analysis. If the illustration of the 
image is not uniform, or the image contains features of 
different reflectivity, or the objects cast shadows, it is al- 
most certain that there is no perfect global threshold for 
edge intensity, and thresholding process itself may be- 
come very complicated. 

[0519] Using a math memory, step (1) and (2) can be altogether 
canceled, and the raw intensities of all pixels are used for 
subsequent processing without any increase of instruction 
cycles. Thresholding may be applied to visualize the pro- 
cessed image after a step, but it can be kept out of the 



image processing itself until the last step. 
Line Recognition 



[0520] Due to neighbor-to-neighbor connectivity, CP memory 
can treat line detection problem as a neighbor counting 
problem. A line can be made of pixels of up to a distance 
apart, which is called the pixel span of the line. A continu- 
ous line lying exactly along X or Y direction thus has pixel 
span of 1. On a real image, edge lines are of primary im- 
portance, each of which separates pixels on its two sides 
into two intensity groups. Thus, the following discussion 
is limited to detecting edge lines, although the stated al- 
gorithms can be easily adopted to detecting other lines, 
such as intensity lines. 

[0521] Jo detect edges line of pixel span 1 and pixel length L ly- 
ing exactly along X direction left to each pixel, the neigh- 
borhood count algorithm is direct: 

[0522] (1) Each of all pixels subtracts the raw intensity of its bot- 
tom layer from that of its top layer, and stores the result 
in the neighboring layer. 

[0523] (2) Each of all pixels sums the neighboring layers of its L 
left neighbors together with its own. The absolute value of 
the result indicates the possibility of an edge line starting 
from that pixel, while the sign of the result indicates 



whether the edge is rising or falling along the Y direction. 

[0524] The algorithm to detect edge line lying exactly along X di- 
rection is similar. 

[0525] Jo detect edge lines with a slope of (My / Mx), each pixel 
defines a super lattice of Mx by My pixels denoted as (Mx 
* My), and the line which connects the pixel and the fur- 
thest corner of the super lattice has the slope of (My / 
Mx). Similar to obtaining the section sums in a sum algo- 
rithm, a messenger starts from furthest corner of the su- 
per lattice, walks (Mx + My) steps along the line until it 
reaches the original pixel. In each of its stop, if the pixel 
is on the left side of the line, its intensity is added to the 
messenger; otherwise, if the pixel is on the right side of 
the line, its intensity is subtracted from the messenger. 
When reaching the original pixel, the value of the messen- 
ger indicates the possibility and the slope of the edge line 
which connects the original pixel and the furthest corner 
of the (Mx * My) super lattice. Similar process may carry 
out for the (-Mx * -My) super lattice. This accumulating 
process is carried out concurrently for all the pixels of the 
image, independent of image sizes. FIG. 24 shows the (4 * 
3) super lattice to detection a line with a slope of (3/4) 
passing the original pixel at 0. The accumulation process- 



ing is from pixel 7 to pixel 0 in sequence, with the intensi- 
ties of pixel i, 3, and 5 to be added, and the intensities of 
pixel 2, 4, and 6 to be subtracted from the messenger. 
[0526] If multiplication is used, the line detection algorithm can 
be further improved. At each stop of the line detection al- 
gorithm, through the concurrent bus 109, a weight factor 
for the stop is sent concurrently to all the messengers, 
which multiply the weight factor with the pixel intensities 
of the stop and accumulate the result. The weight factor is 
inversely proportional to the distance between the line 
and the pixel at the stop. In FIG. 24, assuming the edge 
line half-width of 1, the corresponding weight factors 
could be: 

An example of weight factors for line detection 
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[0527] Given an angular resolution requirement, a {(Mx, My)} set 
can be constructed to detect all lines on an image, each 
element of which can be determined by a corresponding 
line detection algorithm. FIG. 25a shows a set of origin- 
bounding lines whose pixel spans are exactly 7 in walking 
distance, on a square grid. It also shows the walking dis- 
tance envelope of 7. For such a line set of walking dis- 



tance D, the angular resolution is ~(2/D) along the 
45-degree diagonal direction, and ~(1/D) along the X and 
Y directions; the total instruction cycle count is ~ DA2, in- 
dependent of the image size. 

[0528] To reduce the instruction cycles for detecting the lines, 
starting from a {(Mx, My)} set of D in walking distance, a 
circuit of radius ~(D/sqrt(2)) in real distance may be used 
to guide the starting walking pixels for the messengers, to 
also have slightly more uniform angular resolution. FIG. 
25b shows such a set of origin-bounding lines whose 
pixel spans are ~5 in real distance, on the same square 
grid. It also shows the real distance envelope of 5. 

[0529] If a (Mx * My) super lattice in the set have stop(s) that 
passes the line exactly, lines of short pixel span in that 
direction also need to be added to the set. For an exam- 
ple, the super lattice (5 * 0) of the set adds super lattices 
(4 * 0), (3 * 0), (2 * 0) and (1 * 0) to the set. As a result of 
line detection, each pixel is marked by the line value of 
the highest normalized absolute value together with its 

corresponding super lattice. 
Long Range Connectivity 

[0530] Adding long-range connectivity generally reduces the in- 
struction cycle count for global operations. FIG. 26 shows 



the log3(N) long range connectivity, in which N equals 27. 
In FIG. 26, all dots in each column represent a memory el- 
ement, which is marked by the element address at the 
top, and different layer represents different range of con- 
nectivity, such as neighbor-to-neighbor or between every 
3^0 neighbors 171, between every 3^1 neighbors 172, be- 
tween every 3'^2 neighbors 173, and between every 3^3 
neighbors 174. In limit finding or sum, the results of three 
neighbors are sent to next layer of longer range of con- 
nectivity, so that the total instruction cycle count are 
log3(N) in both cases. Similar algorithm may also be ap- 
plied to sorting and fast Fourier transformation. 
Super-lattice Connectivity 

[0531] Long-range connectivity is a special type of super-lattice 
connectivity. It may be difficult to change the connectivity 
after a CP memory has been made, but it is quite feasible 
that all elements in an M-dimension lattice is a subset of 
a (M+l)-dimension lattice, with each M-dimension lattice 
connected on a different super lattice. 

[0532] FFIC. 27a shows an example of 2-D super-lattice connec- 
tivity. Instead of connecting all nodes along the X and Y 
directions, to detection a line which lies specifically along 
the direction from node 0 to node 7, it connects node 0 



and node 7, and node 0 and node 2, so that the direct 
neighborhood counting algorithm can be used concur- 
rently on all the nodes to detect the line in the specific di- 
rection. FIG. 27b shows an example of 2-D super-lattice 
connectivity. It composes of planes of 2-D super-lattice 
connectivity, each is specialized for detecting lines in one 
direction similar to that of FIG. 27a. All these planes have 
same pixel registry between the planes, to allow direct 
connections between registered nodes between different 
planes. The image data may come from a steady source, 
such as a video camera. The data pass all 2-D super lat- 
tices in turn, which works concurrently and continuously 
on the same instructions as part of a SIMD pipeline, and 
finally emerges with the best line value and the associated 

super lattice attached to each pixel. 
Parallel Divider 

[0533] FIG. 28 shows a circuitry algorithm for parallel divider us- 
ing an all-line decoder, a carry pattern generator, a paral- 
lel counter, and a priority encoder. The dividend 161 is in- 
put into an all-line decoder, to generate continuous bit 
outputs up to the dividend 163. The divisor 162 is input 
into a carry-pattern generator, to generate the corre- 
sponding carry pattern 164. The two sets of bit outputs 



are AND-combined together. The combined bit outputs 
are counted by a parallel counter, to get the quotient of 
the division 165. Meanwhile, the combined bit outputs are 
also processed by an encoder of high-to-low priority, to 
get the largest bit output of the carry pattern generator 
which is less than or equal to the dividendi66, and thus 
the value of dividend minus reminder 167 
[0534] Because a CP memory may already have an all-line de- 
coder, a carry pattern generator, and a parallel counter, by 
caching the bit outputs of the general decoder, the CP 
memory may also be a parallel divider in addition, which, 
due to the functionality of the general decoder, provides 
slightly more powerful functionality of obtaining the quo- 
tient and the value of dividend minus reminder, of divid- 
ing a dividend by a divider, the dividend being the value 

of a subtrahend minus an offset. 
Functional Overview of Concurrent Processing memory 

[0535] As illustrated by FIG. 29, in which the general decoder, the 
priority encoder, and the parallel counter have been 
packed into an element control unit, a general CP memory 
can be summarized by the following rules: 

[0536] (1) A CP memory is made of identical elements, each of 
which has a unique address. 



[0537] (2) Each memory is connected with a data bus. 

[0538] (3) One element can read from or write to the data bus 
exclusively. 

[0539] (4) Multiple elements can be activated by an element con- 
trol unit. A memory element is activated if its element ad- 
dress corresponds to the increments of a carry number 
starting at a start address and if it is equal to or less than 
an end address 

[0540] (5) Multiple activated elements can read from the data bus 
concurrently. 

[0541] (5) Multiple activated elements can be required to identify 
themselves concurrently. Each element positively asserts a 
line which connects the element back to the element con- 
trol unit 

[0542] (7) Each element contains a fixed number of registers. 

[0543] (8) The neighboring elements are connected so that an el- 
ement can read at least one register of its neighbor. 

[0544] (9) There is an extra external command pin to indicate the 
address and data bus contains whether an instruction, or 
address and data for the memory when it is enabled. 

[0545] Rule (1), (2) and (3) specifies the functional backward 

compatibility with a conventional random access memory. 



Rule (4), (5) and (6) defines concurrency. Rule (7) and (8) 
defines connectivity. Rule (9) defines processing capabil- 
ity. 



